-- Logs begin at Fri 2022-09-09 20:46:17 UTC, end at Fri 2022-09-09 21:58:15 UTC. -- Sep 09 21:17:22.235831 dv-cinder-852210-15-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 21:17:22.243902 dv-cinder-852210-15-smb devstack@keystone.service[81596]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 21:17:22 2022] *** Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: nodename: dv-cinder-852210-15-smb Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: machine: x86_64 Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: clock source: unix Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: pcre jit disabled Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: detected number of CPU cores: 4 Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: current working directory: / Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: detected binary path: /usr/bin/uwsgi-core Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: your processes number limit is 47680 Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: your memory page size is 4096 bytes Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: detected max file descriptor number: 2048 Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: lock engine: pthread robust mutexes Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: thunder lock: enabled Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 21:17:22.247647 dv-cinder-852210-15-smb devstack@keystone.service[81596]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 21:17:22.286851 dv-cinder-852210-15-smb devstack@keystone.service[81596]: Python main interpreter initialized at 0x555740fbb9c0 Sep 09 21:17:22.286851 dv-cinder-852210-15-smb devstack@keystone.service[81596]: python threads support enabled Sep 09 21:17:22.286851 dv-cinder-852210-15-smb devstack@keystone.service[81596]: your server socket listen backlog is limited to 100 connections Sep 09 21:17:22.286851 dv-cinder-852210-15-smb devstack@keystone.service[81596]: your mercy for graceful operations on workers is 90 seconds Sep 09 21:17:22.287241 dv-cinder-852210-15-smb devstack@keystone.service[81596]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 21:17:22.287319 dv-cinder-852210-15-smb devstack@keystone.service[81596]: *** Operational MODE: preforking *** Sep 09 21:17:22.287557 dv-cinder-852210-15-smb devstack@keystone.service[81596]: *** uWSGI is running in multiple interpreter mode *** Sep 09 21:17:22.287557 dv-cinder-852210-15-smb devstack@keystone.service[81596]: spawned uWSGI master process (pid: 81596) Sep 09 21:17:22.287767 dv-cinder-852210-15-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 21:17:22.288506 dv-cinder-852210-15-smb devstack@keystone.service[81596]: spawned uWSGI worker 1 (pid: 81610, cores: 1) Sep 09 21:17:22.290380 dv-cinder-852210-15-smb devstack@keystone.service[81596]: spawned uWSGI worker 2 (pid: 81611, cores: 1) Sep 09 21:17:22.290380 dv-cinder-852210-15-smb devstack@keystone.service[81596]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 21:17:26.644153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:17:26.644153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: from cryptography.utils import int_from_bytes Sep 09 21:17:26.644981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:17:26.644981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: from cryptography.utils import int_from_bytes Sep 09 21:17:26.645134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:17:26.645134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: from cryptography.utils import int_from_bytes Sep 09 21:17:26.645540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:17:26.645540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: from cryptography.utils import int_from_bytes Sep 09 21:17:26.694877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:17:26.695074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:17:26.695242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] command line args: [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:17:26.695460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:17:26.695549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:17:26.695653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:17:26.695741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ================================================================================ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:17:26.695848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] command line args: [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:17:26.695929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] admin_token = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.696116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:17:26.696203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config_dir = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.696305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.696393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ================================================================================ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:17:26.696472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] config_source = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.696567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] admin_token = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.696651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] debug = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.696810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_dir = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.696900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] config_source = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] debug = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.697907 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_config_append = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_dir = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.698946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_config_append = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_dir = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.699955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.700859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.701964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.702104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.702213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.702454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.702536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.702691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] publish_errors = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.702778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.702919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] publish_errors = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.703952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] standard_threads = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] standard_threads = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_journal = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.704994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_json = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.705190 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.705271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_stderr = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.705354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] use_syslog = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.705524 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.705602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.705703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.705816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.705900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_journal = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.706040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_json = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.706119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.706215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_stderr = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.706300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.706392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] use_syslog = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.706516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.706674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:17:26.706749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.706868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.706983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.707104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.707228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.707361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.707446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.707599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.707692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.708948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.709919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.710870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.711977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.712913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.713940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.714868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.715919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.716953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.717941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.718947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.719090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.719180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.719314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.719529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.719607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.719773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.719852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.720996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.721980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.722939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.723880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.724975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.725941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.726948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.727902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.728032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.728122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.728234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.728563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.728713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.728792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.728946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.729992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.730913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.external = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.731896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.password = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] auth.token = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.external = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.732873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.password = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.733982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] auth.token = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.734919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.735940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.736740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.736872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.736964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.737973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.738927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.739889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.740987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.741948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.742962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.743895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.744972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.745923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.746932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.747880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.748957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.749055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.749217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.749297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.754793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.754969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755530 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.755930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.756948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.757962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.758965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.759973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.760997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.761933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762790 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.762936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.763960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.764934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.765961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.766890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.767894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.768925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.769941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.770104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.770192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.770355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.770496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.770602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.770829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.770973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.771854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.772959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.773997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.774160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.774272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.774402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.774636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.774876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.775117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.775361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.775594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.775830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.776063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.776305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.776574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.776801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.777075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.777323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.777578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.777819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.778064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.778298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.778658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.778925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.779186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.779445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.779680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.779922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.780164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.780283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.780522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.780776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.781079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.783859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.783859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.783859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.783859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.783859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.783859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:17:26.784256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.784256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.784387 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.784585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.784855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.785137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.785414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.785719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.785974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.786230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.786484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.786740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.786982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.787225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.787464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.787759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.788036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.788270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.788519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.788788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.789069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.789320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.789572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.789812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.790056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.790295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.790532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.790769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.791004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.791247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.791483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.791725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.791961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.792209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.792443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.792687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.792925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.793281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.793518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:17:26.793688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:17:26.812574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.812801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.813044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.819852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.820082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.820310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.821986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.828540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.850382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.850611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.855507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.855764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.909869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.916040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.958393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.958619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.961563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:26.961800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.122940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.123174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.123385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.123608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.123826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.124039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.124483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.124717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.124943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.125186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.125404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.125639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.153163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.153459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.153576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.153659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.153735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.153888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.154808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.165741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.165844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.178333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.178568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.178803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.179840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.180058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.180270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.180480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81611) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 21:17:27.196785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.196992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 21:17:27.197359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.197556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 21:17:27.197767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.197903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.197983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 21:17:27.198084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.198234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.198343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.198433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 21:17:27.198600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.198689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.198939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.199196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.199452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.208884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.209212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.209486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.209770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.209984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.210265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.210536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.210816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.216681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.217836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.219578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.219860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.220139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.220524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.220827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.220966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.221102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.221267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.221350 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.221552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.221634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.221839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.221924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.222124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.222204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.222387 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.222484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.222660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.222934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.223206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.223480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.223748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.245603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.247050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.247332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.247681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.249150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.249435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.252551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.252956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.253260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.254681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.254999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.255286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.259549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.259834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.261982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.262267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.265457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.265748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.266030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.266250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.266334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.270856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.282908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.283177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.286273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.286552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.287012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.290232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.290449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.290641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.293558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.293853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.294676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.297898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.298297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.301615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.301911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.302184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.302304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.302463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.302737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.303031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.305348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.305656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.305942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.306336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.306627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.306916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.319282 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.319568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.319842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.320101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.323377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.323667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.323933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.324196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.326910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.328436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.329991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.330274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.331135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.332813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.332947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.333221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.333504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.333780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.334171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.334367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.334642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.337364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.337648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.337930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.338213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.338500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.345256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.345567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.345848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.346128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.346506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.346784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.347071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.350599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.350881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.351158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.351434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.351709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.351981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.352254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.363097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.366002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.368698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.368853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.370353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.371716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.371816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.372068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.372462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.374679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.376193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.379225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.379225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.379225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.379415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.380815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.383697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.384092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.384379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.384656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.385766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.387215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.390185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.390477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.390799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.391180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.392416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.392707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.392988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.399150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.399442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.399723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.399822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.400081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.400363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.400641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.400914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.401220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.401494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.401773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.402041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.402322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.402598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.402866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.403131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.403404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.406749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81611) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 21:17:27.407032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.407893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.407893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.407893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.408140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.408489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.408711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.408978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.409284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.409562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.409832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.410096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.410367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81611) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 21:17:27.437652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555740fbb9c0 pid: 81610 (default app) Sep 09 21:17:27.441581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ee43-b8ca-4888-add0-f6391cdbdd69 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:27.441866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ee43-b8ca-4888-add0-f6391cdbdd69 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:27.442138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ee43-b8ca-4888-add0-f6391cdbdd69 None None] PATH_INFO: `/v3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:27.445435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555740fbb9c0 pid: 81611 (default app) Sep 09 21:17:27.446236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Fri Sep 9 21:17:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:35.382882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10521-c347-4973-9713-978d0b1a352c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:35.383396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10521-c347-4973-9713-978d0b1a352c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:35.383396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10521-c347-4973-9713-978d0b1a352c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:35.387983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:17:35.393939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:35.394342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:35.394486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:35.465833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: INFO dbcounter [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] Registered counter for database keystone Sep 09 21:17:35.487501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG oslo_db.sqlalchemy.engines [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:17:35.493681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writer thread running {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:17:35.674482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG passlib.handlers.bcrypt [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81610) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 21:17:35.674792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG passlib.handlers.bcrypt [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81610) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 21:17:35.732476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:35.734122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:35.862379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 09 21:17:36.354051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc10521-c347-4973-9713-978d0b1a352c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:36.423797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: INFO dbcounter [None req-8dc10521-c347-4973-9713-978d0b1a352c None None] Registered counter for database keystone Sep 09 21:17:36.443417 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc10521-c347-4973-9713-978d0b1a352c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:17:36.449535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writer thread running {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:17:36.568076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc10521-c347-4973-9713-978d0b1a352c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:36.572305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52611b5a-a9ed-4710-9d92-c7276d6b9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:36.572937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52611b5a-a9ed-4710-9d92-c7276d6b9817 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:36.573240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52611b5a-a9ed-4710-9d92-c7276d6b9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:36.573508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52611b5a-a9ed-4710-9d92-c7276d6b9817 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:36.581913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52611b5a-a9ed-4710-9d92-c7276d6b9817 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:36.634065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING keystone.common.rbac_enforcer.enforcer [None req-52611b5a-a9ed-4710-9d92-c7276d6b9817 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 21:17:36.634347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52611b5a-a9ed-4710-9d92-c7276d6b9817 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:36.643750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Sep 9 21:17:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 21:17:36.649819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:36.666879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84136c-ebc2-4b1b-b1fb-149766e1b1df None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:36.671338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d21c37-544f-4c5a-989a-b966b7772b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:36.672437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d21c37-544f-4c5a-989a-b966b7772b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:36.672717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d21c37-544f-4c5a-989a-b966b7772b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:36.673595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d21c37-544f-4c5a-989a-b966b7772b9b admin admin] PATH_INFO: `/v3/projects/d490483b5cc64ba0b5021ee96204079c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:36.675174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d21c37-544f-4c5a-989a-b966b7772b9b admin admin] RBAC: Authorizing `identity:get_project(project_id=d490483b5cc64ba0b5021ee96204079c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:36.727339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e8d21c37-544f-4c5a-989a-b966b7772b9b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 21:17:36.727679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d21c37-544f-4c5a-989a-b966b7772b9b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:36.732383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Fri Sep 9 21:17:36 2022] GET /identity/v3/projects/d490483b5cc64ba0b5021ee96204079c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:38.861319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2cb0-38a0-41ff-9ae0-f16974df4380 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:38.861726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2cb0-38a0-41ff-9ae0-f16974df4380 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:38.861881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2cb0-38a0-41ff-9ae0-f16974df4380 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:38.866584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:38.872105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c712fa-63c1-4b10-8243-986db2722605 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:38.872514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c712fa-63c1-4b10-8243-986db2722605 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:38.872649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c712fa-63c1-4b10-8243-986db2722605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:38.892460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-33c712fa-63c1-4b10-8243-986db2722605 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:38.894018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-33c712fa-63c1-4b10-8243-986db2722605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:38.901705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 09 21:17:39.177504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a2cb0-38a0-41ff-9ae0-f16974df4380 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:39.189907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a2cb0-38a0-41ff-9ae0-f16974df4380 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:39.194177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3936d6-ac8d-41f7-81d1-0370d50f5545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:39.194774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3936d6-ac8d-41f7-81d1-0370d50f5545 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:39.195051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3936d6-ac8d-41f7-81d1-0370d50f5545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:39.195318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3936d6-ac8d-41f7-81d1-0370d50f5545 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:39.202737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3936d6-ac8d-41f7-81d1-0370d50f5545 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:39.205133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3936d6-ac8d-41f7-81d1-0370d50f5545 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:39.213569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Sep 9 21:17:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:17:39.218834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c712fa-63c1-4b10-8243-986db2722605 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:39.228126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c712fa-63c1-4b10-8243-986db2722605 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:39.232404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221611-0294-435b-8762-bafa6d06eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:39.233043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221611-0294-435b-8762-bafa6d06eb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:39.233335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221611-0294-435b-8762-bafa6d06eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:39.233610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221611-0294-435b-8762-bafa6d06eb57 admin admin] PATH_INFO: `/v3/users/d133fe6374bc4975bb8873cbc865761e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:39.234917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221611-0294-435b-8762-bafa6d06eb57 admin admin] RBAC: Authorizing `identity:get_user(user_id=d133fe6374bc4975bb8873cbc865761e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:39.237702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221611-0294-435b-8762-bafa6d06eb57 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:39.239210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Fri Sep 9 21:17:39 2022] GET /identity/v3/users/d133fe6374bc4975bb8873cbc865761e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:41.493008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98a44f-16c5-4d84-930d-f963d98fe640 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:41.493575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98a44f-16c5-4d84-930d-f963d98fe640 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:41.493575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98a44f-16c5-4d84-930d-f963d98fe640 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:41.494926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:41.500966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add875-534a-4cf8-896c-a18d398bc67f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:41.501532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add875-534a-4cf8-896c-a18d398bc67f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:41.501532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add875-534a-4cf8-896c-a18d398bc67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:41.523181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-36add875-534a-4cf8-896c-a18d398bc67f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:41.524382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-36add875-534a-4cf8-896c-a18d398bc67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:41.609672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 6/11] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:41.614308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20d7a-53e5-43c3-8b25-ace325ef942b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:41.614598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20d7a-53e5-43c3-8b25-ace325ef942b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:41.614878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20d7a-53e5-43c3-8b25-ace325ef942b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:41.616187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 6/12] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:41.621333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a3d7-004b-41a3-a225-3b8df7eb66bc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:41.621626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a3d7-004b-41a3-a225-3b8df7eb66bc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:41.621925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a3d7-004b-41a3-a225-3b8df7eb66bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:41.641164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9651a3d7-004b-41a3-a225-3b8df7eb66bc None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:41.642928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9651a3d7-004b-41a3-a225-3b8df7eb66bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:41.659362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:41.710457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:41.879665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20d7a-53e5-43c3-8b25-ace325ef942b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:41.978984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a3d7-004b-41a3-a225-3b8df7eb66bc None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:42.024490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20d7a-53e5-43c3-8b25-ace325ef942b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.060570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.061463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.061740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.062012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.073625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:17:42.079071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a3d7-004b-41a3-a225-3b8df7eb66bc None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:17:42.082550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:42.083554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:17:42.084917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:42.089443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:42.114301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.114846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.115126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.115396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.125210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:42.137080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:42.183159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:42.184789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:42.191758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3adecc-6360-47b1-af12-fe3bb1c3843e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.225537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.226152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.226457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.226708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.227386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:42.227939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:42.229352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:42.241800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:42.247213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:42.284626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:17:42.290310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:42.340111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:42.341432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:42.346371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4cf81-b91e-42cb-9981-ed3dc08f3915 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.379230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.379791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.380062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.380338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] PATH_INFO: `/v3/users/d133fe6374bc4975bb8873cbc865761e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.381917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] RBAC: Authorizing `identity:get_user(user_id=d133fe6374bc4975bb8873cbc865761e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:42.384482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:42.385101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:17:42 2022] GET /identity/v3/users/d133fe6374bc4975bb8873cbc865761e => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:42.388896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e0698-e61f-42bd-99d5-1909a1e1d67d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.390356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:42.423816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.424462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.424743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.425020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.435082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:42.436532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:17:42.455316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:42.456378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:17:42.457237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:17:42.457237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:17:42.457237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:17:42.457237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:17:42.462351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:42.490979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73b2e-cfa2-4793-9b96-2c9c1ae78294 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.524535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.525186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.525466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.525737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.526936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:42.528368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:42.529925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:42.536232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:42.563768 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d1b76-48e3-4a4e-ba48-3d671395b497 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.566054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:42.568520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:42.597611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a34ba-6f73-4638-98cc-a3842b2c5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.598299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a34ba-6f73-4638-98cc-a3842b2c5297 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.598580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a34ba-6f73-4638-98cc-a3842b2c5297 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.598857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a34ba-6f73-4638-98cc-a3842b2c5297 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.599490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a34ba-6f73-4638-98cc-a3842b2c5297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:42.599796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a34ba-6f73-4638-98cc-a3842b2c5297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:42.601204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a34ba-6f73-4638-98cc-a3842b2c5297 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:42.618743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:42.636836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54775246-3d18-4ee1-b072-abfa27882d66 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:42.673754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe63d-05f6-4b52-8b23-6cefde37f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:42.674427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe63d-05f6-4b52-8b23-6cefde37f955 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:42.674704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe63d-05f6-4b52-8b23-6cefde37f955 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:42.674974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe63d-05f6-4b52-8b23-6cefde37f955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:42.675714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe63d-05f6-4b52-8b23-6cefde37f955 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.domain.id=default, user.id=d133fe6374bc4975bb8873cbc865761e) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:42.676022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe63d-05f6-4b52-8b23-6cefde37f955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:42.677534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe63d-05f6-4b52-8b23-6cefde37f955 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:42.686698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Sep 9 21:17:42 2022] GET /identity/v3/role_assignments?user.id=d133fe6374bc4975bb8873cbc865761e&scope.domain.id=default&role.id=eea82d73b0db450f9f23e5256483a93e => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:44.984046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fb50-8ee5-4e47-89bf-52c059f0d983 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:44.985270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fb50-8ee5-4e47-89bf-52c059f0d983 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:44.985775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fb50-8ee5-4e47-89bf-52c059f0d983 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:44.987643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:44.992627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f1dff-3fc7-4200-8c36-afdb0346fe3f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:44.993529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f1dff-3fc7-4200-8c36-afdb0346fe3f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:44.994003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f1dff-3fc7-4200-8c36-afdb0346fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:45.020074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG passlib.handlers.bcrypt [None req-3e4f1dff-3fc7-4200-8c36-afdb0346fe3f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81611) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 21:17:45.020824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG passlib.handlers.bcrypt [None req-3e4f1dff-3fc7-4200-8c36-afdb0346fe3f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81611) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 21:17:45.086279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3e4f1dff-3fc7-4200-8c36-afdb0346fe3f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:45.088250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3e4f1dff-3fc7-4200-8c36-afdb0346fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:45.195705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:45.485415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb1ee1-c5f2-4dd2-a8a1-e9f3c0b2959a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:45.486073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb1ee1-c5f2-4dd2-a8a1-e9f3c0b2959a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:45.486547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb1ee1-c5f2-4dd2-a8a1-e9f3c0b2959a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:45.488073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:45.493970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3216-b47b-434b-8a69-9a82ee8b4a26 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:45.494495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3216-b47b-434b-8a69-9a82ee8b4a26 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:45.495057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc3216-b47b-434b-8a69-9a82ee8b4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:45.521790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-57fc3216-b47b-434b-8a69-9a82ee8b4a26 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:45.523391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-57fc3216-b47b-434b-8a69-9a82ee8b4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:45.558457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:45.622735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:45.678155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b294-6d47-4ea2-8897-2c1e17793fe0 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:45.678785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b294-6d47-4ea2-8897-2c1e17793fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:45.679255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b294-6d47-4ea2-8897-2c1e17793fe0 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:45.680795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 13/26] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:45.686137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed87a8-18b0-4877-9850-179d01b65281 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:45.686663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed87a8-18b0-4877-9850-179d01b65281 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:45.687146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed87a8-18b0-4877-9850-179d01b65281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:45.714153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5eed87a8-18b0-4877-9850-179d01b65281 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:45.715369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5eed87a8-18b0-4877-9850-179d01b65281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:45.728385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b294-6d47-4ea2-8897-2c1e17793fe0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:45.822675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 14/27] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:45.825070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7e4e2-26c0-4785-a1d4-ad4640dffce4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:45.825742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7e4e2-26c0-4785-a1d4-ad4640dffce4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:45.827422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7e4e2-26c0-4785-a1d4-ad4640dffce4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:45.829686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 15/28] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:45.839422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e776-f241-4d3c-baf8-573cfd48e4b5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:45.839973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e776-f241-4d3c-baf8-573cfd48e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:45.840453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e776-f241-4d3c-baf8-573cfd48e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:45.877686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-87f9e776-f241-4d3c-baf8-573cfd48e4b5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:45.878898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-87f9e776-f241-4d3c-baf8-573cfd48e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:45.940168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b294-6d47-4ea2-8897-2c1e17793fe0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:46.022559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:46.023412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.023767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:46.024060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:46.025425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 16/29] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:17:46.048751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:17:46.054878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:46.055897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:17:46.057113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 14/30] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:46.064369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e776-f241-4d3c-baf8-573cfd48e4b5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:46.099121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:46.162103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:46.204443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e776-f241-4d3c-baf8-573cfd48e4b5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:46.216503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:46.249723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:46.250738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.251210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:46.251689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:46.252549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:46.253088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:46.254923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:46.264472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 17/31] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:46.265543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:46.351799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94a99e-0707-4e6d-8014-0d0212f65915 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:46.391716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:46.415771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375d4d4-2c82-4eea-b998-b88bfec6934b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:46.429539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:46.430196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.430480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:46.430754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:46.442972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:46.445208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:46.459092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:46.460010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.460514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:46.460997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:46.461975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:17:46.462831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:46.463667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:17:46.464449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:17:46.464449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:17:46.464449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:17:46.464449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 15/32] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:46.464714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:46.466462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:46.553203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:46.580240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce100db3-f580-4d4e-9de5-ea5fcd3a7ba8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:46.625426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:46.625426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.625426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:46.625426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] PATH_INFO: `/v3/users/d133fe6374bc4975bb8873cbc865761e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:46.625987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=d133fe6374bc4975bb8873cbc865761e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:46.625987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:46.626521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 16/33] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:17:46 2022] GET /identity/v3/users/d133fe6374bc4975bb8873cbc865761e => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:46.627274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:46.703124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 18/34] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Sep 9 21:17:46 2022] POST /identity/v3/roles => generated 219 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:17:46.705789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:46.749952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091538df-291d-4e72-a548-208efd45e5b9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:46.792414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d121533-82f6-4557-afbc-609383b6359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:46.793211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121533-82f6-4557-afbc-609383b6359f None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.793709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121533-82f6-4557-afbc-609383b6359f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:46.794029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d121533-82f6-4557-afbc-609383b6359f None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:46.795027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d121533-82f6-4557-afbc-609383b6359f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:46.796361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d121533-82f6-4557-afbc-609383b6359f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:46.840775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f261e6-4dfa-44a2-b508-df4444bb696e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:46.886786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:46.887816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.888297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:46.888799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:46.889864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:46.890399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:46.892724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:46.908678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:46.920017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 19/35] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:46.921271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:46.995144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 17/36] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Sep 9 21:17:46 2022] POST /identity/v3/roles => generated 225 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:17:46.996663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c782-6368-4e91-81f2-2f777283d1a7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:46.996955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c782-6368-4e91-81f2-2f777283d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.005540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c782-6368-4e91-81f2-2f777283d1a7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.007133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 18/37] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:47.007897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c782-6368-4e91-81f2-2f777283d1a7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:47.013315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:47.046870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c8b2-df6f-472f-a881-e5b796902376 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:47.088961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95abd-b5e7-4244-b54c-399f2d67ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:47.089640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95abd-b5e7-4244-b54c-399f2d67ee40 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:47.089924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95abd-b5e7-4244-b54c-399f2d67ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.090196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95abd-b5e7-4244-b54c-399f2d67ee40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.091829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a95abd-b5e7-4244-b54c-399f2d67ee40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:47.093356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a95abd-b5e7-4244-b54c-399f2d67ee40 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:47.095329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:47.096773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5891c-cf54-4bc2-bb8f-124acd987839 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:47.097083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5891c-cf54-4bc2-bb8f-124acd987839 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.097363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5891c-cf54-4bc2-bb8f-124acd987839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.117282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-efe5891c-cf54-4bc2-bb8f-124acd987839 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:47.118840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-efe5891c-cf54-4bc2-bb8f-124acd987839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:47.145734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c782-6368-4e91-81f2-2f777283d1a7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:47.181359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531f341-7d69-4405-9243-01b5d974c975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:47.181994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f341-7d69-4405-9243-01b5d974c975 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:47.182273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f341-7d69-4405-9243-01b5d974c975 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.182542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f341-7d69-4405-9243-01b5d974c975 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.183223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531f341-7d69-4405-9243-01b5d974c975 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:47.184793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531f341-7d69-4405-9243-01b5d974c975 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:47.186782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:47.205068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 21/39] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:47.205068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132e3e-4ff5-4196-964d-6f512932695a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:47.205068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132e3e-4ff5-4196-964d-6f512932695a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.205068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132e3e-4ff5-4196-964d-6f512932695a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.205068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 22/40] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:47.205068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132e3e-4ff5-4196-964d-6f512932695a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:47.321789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132e3e-4ff5-4196-964d-6f512932695a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:47.331323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 19/41] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:17:47 2022] POST /identity/v3/projects => generated 301 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:17:47.332580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882b99-ce46-4d8f-85a8-86be716f3669 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:47.332869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882b99-ce46-4d8f-85a8-86be716f3669 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.333179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882b99-ce46-4d8f-85a8-86be716f3669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.354890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-61882b99-ce46-4d8f-85a8-86be716f3669 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:47.356681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-61882b99-ce46-4d8f-85a8-86be716f3669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:47.387133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:47.388197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:47.388706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.389293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] PATH_INFO: `/v3/domains/default/users/d133fe6374bc4975bb8873cbc865761e/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.392167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d133fe6374bc4975bb8873cbc865761e, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:47.394399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:47.415862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:47.441058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 20/42] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:47.469790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 23/43] 10.222.0.60 () {58 vars in 1361 bytes} [Fri Sep 9 21:17:47 2022] PUT /identity/v3/domains/default/users/d133fe6374bc4975bb8873cbc865761e/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:17:47.482643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882b99-ce46-4d8f-85a8-86be716f3669 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:47.607323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882b99-ce46-4d8f-85a8-86be716f3669 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:47.745525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:47.753547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:47.754165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:47.754446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:47.754721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:47.755849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:47.757643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:47.807303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:47.841048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 21/44] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Sep 9 21:17:47 2022] POST /identity/v3/roles => generated 223 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:17:47.968433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83fe5-37f4-4af1-a239-855a5dc35f41 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:48.024197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c0bd-b9cf-4308-b9cc-cb2b7fbbad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:48.024778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c0bd-b9cf-4308-b9cc-cb2b7fbbad08 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:48.025087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c0bd-b9cf-4308-b9cc-cb2b7fbbad08 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:48.025367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c0bd-b9cf-4308-b9cc-cb2b7fbbad08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:48.027612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c0bd-b9cf-4308-b9cc-cb2b7fbbad08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:48.029091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c0bd-b9cf-4308-b9cc-cb2b7fbbad08 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:48.034380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 24/45] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:48.039959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:48.092863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:48.149352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03bc5a-1e6d-4153-9aee-7d54f98a3333 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:48.183294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303762c-4b19-46a2-85df-d54f18cff5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:48.183908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303762c-4b19-46a2-85df-d54f18cff5d9 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:48.184189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303762c-4b19-46a2-85df-d54f18cff5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:48.184463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303762c-4b19-46a2-85df-d54f18cff5d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:48.185150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303762c-4b19-46a2-85df-d54f18cff5d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:48.186584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303762c-4b19-46a2-85df-d54f18cff5d9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:48.287206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 22/46] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:17:48 2022] POST /identity/v3/projects => generated 312 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:17:49.662068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dba530-a742-450e-a9df-1846bb02a780 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:49.662579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dba530-a742-450e-a9df-1846bb02a780 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:49.662686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dba530-a742-450e-a9df-1846bb02a780 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:49.663998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 25/47] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:49.669271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861baa8-52cc-46b3-aab6-7fd670c290ba None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:49.669695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861baa8-52cc-46b3-aab6-7fd670c290ba None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:49.669942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861baa8-52cc-46b3-aab6-7fd670c290ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:49.688142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e861baa8-52cc-46b3-aab6-7fd670c290ba None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:49.689351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e861baa8-52cc-46b3-aab6-7fd670c290ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:49.753395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 23/48] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:50.021430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dba530-a742-450e-a9df-1846bb02a780 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:50.121338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dba530-a742-450e-a9df-1846bb02a780 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:50.143861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:50.153910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:50.157396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.157396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.157396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.165948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:17:50.171155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:50.172708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:17:50.173669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 26/49] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:50.178625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861baa8-52cc-46b3-aab6-7fd670c290ba None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:50.205086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:50.276116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861baa8-52cc-46b3-aab6-7fd670c290ba None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:50.309477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce596010-d2b7-4427-bd85-d923b19b75e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:50.310107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596010-d2b7-4427-bd85-d923b19b75e1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.310372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596010-d2b7-4427-bd85-d923b19b75e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.310647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596010-d2b7-4427-bd85-d923b19b75e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.311314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce596010-d2b7-4427-bd85-d923b19b75e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:50.311619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce596010-d2b7-4427-bd85-d923b19b75e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:50.313047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce596010-d2b7-4427-bd85-d923b19b75e1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:50.325131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 24/50] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:50.331101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:50.431713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73dac-7679-424d-9a2f-a75c22448c83 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:50.448471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07252c7d-99f2-4721-af43-966bf0fd7775 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.448762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07252c7d-99f2-4721-af43-966bf0fd7775 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.449057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07252c7d-99f2-4721-af43-966bf0fd7775 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.450412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 25/51] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:17:50.456045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454010f0-d766-46c2-9045-5877695bf43f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.456328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454010f0-d766-46c2-9045-5877695bf43f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.456603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454010f0-d766-46c2-9045-5877695bf43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.465066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:50.465707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.465989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.466266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] PATH_INFO: `/v3/users/d133fe6374bc4975bb8873cbc865761e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.467405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] RBAC: Authorizing `identity:get_user(user_id=d133fe6374bc4975bb8873cbc865761e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:50.468850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:50.470983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 27/52] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:17:50 2022] GET /identity/v3/users/d133fe6374bc4975bb8873cbc865761e => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:50.475137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-454010f0-d766-46c2-9045-5877695bf43f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:50.476327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-454010f0-d766-46c2-9045-5877695bf43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:50.476429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:50.528223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:50.541982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 26/53] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:17:50.574344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993dc45-ec2f-49f3-9bee-b1110ffaff4b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:50.608903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:50.609616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.609894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.610163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.611292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:50.612751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:50.614344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 28/54] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:17:50.620185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454010f0-d766-46c2-9045-5877695bf43f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:50.641345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:50.717711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454010f0-d766-46c2-9045-5877695bf43f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:50.750554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:50.751159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.751439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.751718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.752434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.domain.id=default, user.id=d133fe6374bc4975bb8873cbc865761e) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:50.752741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:50.754209 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:50.760893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1322 bytes} [Fri Sep 9 21:17:50 2022] GET /identity/v3/role_assignments?user.id=d133fe6374bc4975bb8873cbc865761e&scope.domain.id=default&role.id=eea82d73b0db450f9f23e5256483a93e => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:50.808158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:50.917136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d1269-592d-4e5c-90c1-4229b1597eee None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:50.938765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:50.953127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b42b3-5461-4f40-8366-8998b7594454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:50.954575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b42b3-5461-4f40-8366-8998b7594454 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:50.954698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b42b3-5461-4f40-8366-8998b7594454 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:50.954943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b42b3-5461-4f40-8366-8998b7594454 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:50.956057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b42b3-5461-4f40-8366-8998b7594454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:50.957574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b42b3-5461-4f40-8366-8998b7594454 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:50.959157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 29/56] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:50.964856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:51.050460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:51.066637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d2c61-787e-4bc1-a770-005d8a79efd3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:51.099208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0acfa-df98-4058-9b6a-c264da44c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:51.099810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0acfa-df98-4058-9b6a-c264da44c7b4 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:51.100089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0acfa-df98-4058-9b6a-c264da44c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:51.100359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0acfa-df98-4058-9b6a-c264da44c7b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:51.101006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0acfa-df98-4058-9b6a-c264da44c7b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:51.102719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0acfa-df98-4058-9b6a-c264da44c7b4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:51.177364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 28/57] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Sep 9 21:17:50 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:17:53.319398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa502-46ee-4dd1-8dc6-a08433a9ee6b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:53.319913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa502-46ee-4dd1-8dc6-a08433a9ee6b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:53.319997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa502-46ee-4dd1-8dc6-a08433a9ee6b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:53.321397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 30/58] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:53.326462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f6657-1911-4c38-9781-1d86a7dd754f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:53.326894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f6657-1911-4c38-9781-1d86a7dd754f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:53.327016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f6657-1911-4c38-9781-1d86a7dd754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:53.345432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-556f6657-1911-4c38-9781-1d86a7dd754f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:53.346626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-556f6657-1911-4c38-9781-1d86a7dd754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:53.411242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 29/59] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:53.679538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa502-46ee-4dd1-8dc6-a08433a9ee6b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:53.777749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa502-46ee-4dd1-8dc6-a08433a9ee6b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:53.810031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d408d5-ecd0-474e-934e-249bc0f196a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:53.810649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d408d5-ecd0-474e-934e-249bc0f196a2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:53.810930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d408d5-ecd0-474e-934e-249bc0f196a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:53.811203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d408d5-ecd0-474e-934e-249bc0f196a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:53.812310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d408d5-ecd0-474e-934e-249bc0f196a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:53.814326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d408d5-ecd0-474e-934e-249bc0f196a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:53.815867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 31/60] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:53.821314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f6657-1911-4c38-9781-1d86a7dd754f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:53.884151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:53.917691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f6657-1911-4c38-9781-1d86a7dd754f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:53.952592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495b074-d01d-471c-8c19-657beb2210af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:53.953355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495b074-d01d-471c-8c19-657beb2210af None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:53.953912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495b074-d01d-471c-8c19-657beb2210af None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:53.954269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495b074-d01d-471c-8c19-657beb2210af None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:53.954979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495b074-d01d-471c-8c19-657beb2210af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:53.956521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495b074-d01d-471c-8c19-657beb2210af None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:54.064481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 30/61] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:17:53 2022] POST /identity/v3/users => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:17:57.333071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693866-8dfc-45b7-aee7-6578865b27ab None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.333071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693866-8dfc-45b7-aee7-6578865b27ab None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.333071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693866-8dfc-45b7-aee7-6578865b27ab None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.333921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 32/62] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:57.338565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9eb5a-be5c-49b2-a418-561bf7996f01 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.339286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9eb5a-be5c-49b2-a418-561bf7996f01 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.339712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9eb5a-be5c-49b2-a418-561bf7996f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.365429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e0e9eb5a-be5c-49b2-a418-561bf7996f01 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:57.366637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e0e9eb5a-be5c-49b2-a418-561bf7996f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:57.470792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 31/63] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:57.517066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55898a-5155-4f62-b343-e17dcc9bff3a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.517682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55898a-5155-4f62-b343-e17dcc9bff3a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.518153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55898a-5155-4f62-b343-e17dcc9bff3a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.519716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 33/64] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:17:57.525243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca3c2-3df0-43bf-98f7-c013a4c81c28 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.525778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca3c2-3df0-43bf-98f7-c013a4c81c28 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.526252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca3c2-3df0-43bf-98f7-c013a4c81c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.554102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f88ca3c2-3df0-43bf-98f7-c013a4c81c28 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:57.555324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f88ca3c2-3df0-43bf-98f7-c013a4c81c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:57.624382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:57.654725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 32/65] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:57.798949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55898a-5155-4f62-b343-e17dcc9bff3a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:57.858329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b3b0-5b34-44dc-bb09-03d42d0a73e7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.858984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b3b0-5b34-44dc-bb09-03d42d0a73e7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.860699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b3b0-5b34-44dc-bb09-03d42d0a73e7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.862952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 33/66] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:57.868288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2c93-cf57-4e1b-86a1-e675e82b2a13 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.868814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2c93-cf57-4e1b-86a1-e675e82b2a13 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.869316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2c93-cf57-4e1b-86a1-e675e82b2a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.884150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:57.896781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-60ce2c93-cf57-4e1b-86a1-e675e82b2a13 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:57.898409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-60ce2c93-cf57-4e1b-86a1-e675e82b2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:57.937529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55898a-5155-4f62-b343-e17dcc9bff3a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:57.982575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:57.983581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.984224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.985307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.993123 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 34/67] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:57.994978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d210a9-3c2b-43f0-acf3-9fc8cb9ac74e None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:57.995509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d210a9-3c2b-43f0-acf3-9fc8cb9ac74e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:57.995989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d210a9-3c2b-43f0-acf3-9fc8cb9ac74e None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:57.997987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 35/68] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:58.006515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f37-4c96-4333-97b4-78a9799e3115 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.007128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f37-4c96-4333-97b4-78a9799e3115 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.007685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f37-4c96-4333-97b4-78a9799e3115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.011921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:17:58.021295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:58.022216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:17:58.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:17:58.024007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:17:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:58.024935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.043175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-79f27f37-4c96-4333-97b4-78a9799e3115 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:58.044882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-79f27f37-4c96-4333-97b4-78a9799e3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:58.133103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 36/70] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:58.134269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27f37-4c96-4333-97b4-78a9799e3115 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.145792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c1220-b729-4023-b822-a2494f26d64a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.168050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.187733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.192734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939245-1bd4-4434-95b4-69291bf6b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.193407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939245-1bd4-4434-95b4-69291bf6b602 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.193688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939245-1bd4-4434-95b4-69291bf6b602 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.194113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939245-1bd4-4434-95b4-69291bf6b602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.210011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41939245-1bd4-4434-95b4-69291bf6b602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-41939245-1bd4-4434-95b4-69291bf6b602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:17:58.216933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:58.217993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:17:58.219498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:17:58.221240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:58.222979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4765d6-9482-41c9-8412-d2dfdfa10ba0 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.223409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4765d6-9482-41c9-8412-d2dfdfa10ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.223838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4765d6-9482-41c9-8412-d2dfdfa10ba0 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.229780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 36/72] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:17:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:17:58.230424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4765d6-9482-41c9-8412-d2dfdfa10ba0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.253692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27f37-4c96-4333-97b4-78a9799e3115 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.292405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3189f-c26b-471a-a3c6-b2c5dc4f3886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.293108 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3189f-c26b-471a-a3c6-b2c5dc4f3886 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.293394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3189f-c26b-471a-a3c6-b2c5dc4f3886 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.293663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3189f-c26b-471a-a3c6-b2c5dc4f3886 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.294353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3189f-c26b-471a-a3c6-b2c5dc4f3886 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:58.295065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3189f-c26b-471a-a3c6-b2c5dc4f3886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:58.296956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3189f-c26b-471a-a3c6-b2c5dc4f3886 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:58.309184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:58.310383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861ca0-6328-445f-b000-14b6349f2092 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.310671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861ca0-6328-445f-b000-14b6349f2092 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.310949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861ca0-6328-445f-b000-14b6349f2092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.328636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e9861ca0-6328-445f-b000-14b6349f2092 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:17:58.329885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e9861ca0-6328-445f-b000-14b6349f2092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:17:58.353810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4765d6-9482-41c9-8412-d2dfdfa10ba0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.393454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.393974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.394425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.394619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.395281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:58.395559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:58.397607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:58.413424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 38/74] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:17:58.413424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861ca0-6328-445f-b000-14b6349f2092 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.417632 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:58.418471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.436208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.461816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.508520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861ca0-6328-445f-b000-14b6349f2092 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.524772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a9103-70ff-4177-9e53-be9d370c356d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.542167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.542803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.543085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.543360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.558327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:17:58.561949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.563105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.563386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.563777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:17:58.565793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:58.566625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:17:58.567456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:17:58.569092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:58.570529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.583910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:58.585996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:58.592111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 38/77] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:58.592111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.669317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.676739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f733e9d-c385-4fa1-a0a6-f6a1312caaef None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.692552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.698329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873de6ff-fb42-43ce-b996-e7ccdc70f349 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.711860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.712526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.712807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.713104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.714289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:58.715749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:58.721477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 40/78] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:58.721477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.731585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.732216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.732493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.732764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] PATH_INFO: `/v3/users/d133fe6374bc4975bb8873cbc865761e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.734704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] RBAC: Authorizing `identity:get_user(user_id=d133fe6374bc4975bb8873cbc865761e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:58.736202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:58.737822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 39/79] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/users/d133fe6374bc4975bb8873cbc865761e => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:58.738570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.818508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440284f-2205-4826-a434-f428e3f118ce None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.844069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815968f-6c4b-4ad2-be1d-60e0e831aa96 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:58.854895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.855505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.857062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.857062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.857283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:58.857564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:58.858887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:58.867278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 41/80] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:58.868081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:58.882411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:58.883019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:58.883299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:58.883574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:58.893476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.915199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:58.953660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:58.955184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:58.969878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcf999-de28-4a42-bb8a-f4c22f898645 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.003888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.004527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.004815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.005124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.015206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:17:59.021197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:17:59.022122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:17:59.022867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 42/81] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:17:59.023507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.056761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 40/82] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:59.057641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.110799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:59.123142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:59.127786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166137-ed8b-404a-aa3e-e2aec429f762 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.161868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd5624-b9db-47dc-8b67-0c4702ae2878 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.163711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.198044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.198044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.198044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.198044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.198044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:59.198443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.198443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.198443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.198443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.261016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.262745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:59.344729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 43/83] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:17:59 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:17:59.350680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.361002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 41/84] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:59.361933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.380638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:59.477725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee804e-8446-42b4-9f68-6bc68936454a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.487200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7167-c3cc-4a87-895d-a6c4d198f12f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.518596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.519258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.519547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.519822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.520969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.523136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:59.524698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 44/85] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:59.524806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.533525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.534650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.534650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.534891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.535586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:17:59.535684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.537022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:59.539153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:59.547889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 42/86] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:59.548688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.584801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:59.645912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab449-050b-41ba-aab8-393925a4b81f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.674832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68b46-9d14-44a2-9771-8a474f594594 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.686191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.686834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.687163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.688158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.690045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.691592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:59.693644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 45/87] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:59.697873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.714883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.715530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.715814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.716091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.717276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.718810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:59.720766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 43/88] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:59.721610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.801618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:59.810539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f077e1-db27-453e-a0bb-21eb2395d644 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.842789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:59.853707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.854661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.855109 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.855523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.856007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abe6e-278c-44e7-9264-80b04701c757 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:17:59.897264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:17:59.897982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:17:59.898268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:17:59.898592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:17:59.899876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.901577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:17:59.903263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 44/89] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:17:59.904119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:17:59.948214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:17:59.949813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:00.039211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:00.064002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc588b2-ea3b-474b-b86f-5b99fbdde3a9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:00.070709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 46/90] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:00.071787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:00.108043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:00.109775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:00.110387 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:00.110860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:00.111830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:00.112627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:00.115015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:00.121859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 45/91] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:17:59 2022] GET /identity/v3/role_assignments?user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:00.122870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:00.183147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:00.238948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc3d1-956b-46a9-b796-29d1a694164f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:00.315381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:00.316486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:00.317105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:00.317576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:00.319214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=d133fe6374bc4975bb8873cbc865761e) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:00.319868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:00.322331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:00.333361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74e6a-6999-414f-9e62-8367cd35115c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:00.338741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 47/92] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:00 2022] GET /identity/v3/role_assignments?user.id=d133fe6374bc4975bb8873cbc865761e&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:00.339617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:00.434048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:00.434725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:00.434960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:00.435234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:00.451750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:00.547288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:00.549216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:00.605402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:00.607942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052a32f-b01a-4899-a6c5-1ec53c94c938 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:00.681157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:00.681808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:00.682091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:00.682367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:00.686297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:00.688317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:00.690206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 48/93] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:00 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:00.711126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:00.752875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 46/94] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:00.758409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:00.842801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee29b-7ca8-4db1-a6e2-2cd292b9b823 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:00.865414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:00.885150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:00.885770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:00.886054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:00.886334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:00.889852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] RBAC: Adding query filter params (role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:00.889852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:00.889852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:00.895629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 49/95] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:00 2022] GET /identity/v3/role_assignments?user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:01.029111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdde306-6b76-4228-aa0b-e7f1cb1f7138 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:01.063357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:01.072350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74625-7f9a-446b-9c9e-2430bbf24cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:01.073000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74625-7f9a-446b-9c9e-2430bbf24cdf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:01.073307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74625-7f9a-446b-9c9e-2430bbf24cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:01.073578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74625-7f9a-446b-9c9e-2430bbf24cdf None admin] PATH_INFO: `/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:01.078563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74625-7f9a-446b-9c9e-2430bbf24cdf None admin] RBAC: Authorizing `identity:get_project(project_id=ccfaa2e28bbf4fd897ff5ae41e104f3c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:01.080248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74625-7f9a-446b-9c9e-2430bbf24cdf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:01.082143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 47/96] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:00 2022] GET /identity/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:01.088797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:01.209537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c67bd-a6e9-4e7a-acf1-9d0ea2f9c3b1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:01.244675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a513c-672b-49a8-a5c3-0e3515e0d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:01.245323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a513c-672b-49a8-a5c3-0e3515e0d93c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:01.245613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a513c-672b-49a8-a5c3-0e3515e0d93c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:01.245890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a513c-672b-49a8-a5c3-0e3515e0d93c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:01.246627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a513c-672b-49a8-a5c3-0e3515e0d93c None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=ccfaa2e28bbf4fd897ff5ae41e104f3c, user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:01.246941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a513c-672b-49a8-a5c3-0e3515e0d93c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:01.248399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a513c-672b-49a8-a5c3-0e3515e0d93c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:01.254559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 50/97] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:01 2022] GET /identity/v3/role_assignments?user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d&scope.project.id=ccfaa2e28bbf4fd897ff5ae41e104f3c&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:02.049942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2d3bc-c030-4a0f-ab50-6c12fe762051 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:02.050559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2d3bc-c030-4a0f-ab50-6c12fe762051 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:02.050559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2d3bc-c030-4a0f-ab50-6c12fe762051 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:02.052147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 48/98] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:02.064733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef044-dbbc-45e2-a417-e9d8d21d8f30 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:02.065727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef044-dbbc-45e2-a417-e9d8d21d8f30 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:02.066216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fef044-dbbc-45e2-a417-e9d8d21d8f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:02.095033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-79fef044-dbbc-45e2-a417-e9d8d21d8f30 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:02.096774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-79fef044-dbbc-45e2-a417-e9d8d21d8f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:02.133866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:02.180346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 51/99] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:02.333443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7df05-89c9-48d0-a17d-0264eb9f0f45 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:02.333790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7df05-89c9-48d0-a17d-0264eb9f0f45 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:02.334032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7df05-89c9-48d0-a17d-0264eb9f0f45 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:02.335654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 49/100] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:02.340516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c38e55-821d-4b0c-a797-b79cdbab8c75 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:02.340810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c38e55-821d-4b0c-a797-b79cdbab8c75 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:02.341109 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c38e55-821d-4b0c-a797-b79cdbab8c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:02.370084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-81c38e55-821d-4b0c-a797-b79cdbab8c75 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:02.371283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-81c38e55-821d-4b0c-a797-b79cdbab8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:02.450677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 52/101] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:02.617980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7df05-89c9-48d0-a17d-0264eb9f0f45 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:02.730969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7df05-89c9-48d0-a17d-0264eb9f0f45 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:02.773862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:02.774492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:02.774834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:02.775109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:02.776352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:02.777980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:02.779598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 50/102] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:02.782429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c38e55-821d-4b0c-a797-b79cdbab8c75 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:02.786057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:02.888310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:02.972898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:02.978283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7aae8-e9ea-4a6c-b57c-ff73ee19f352 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:02.983443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c38e55-821d-4b0c-a797-b79cdbab8c75 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:03.043951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:03.044654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:03.044938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:03.045242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:03.057292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:03.057918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:03.058205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:03.058496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:03.059156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:03.060593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:03.069599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:03.074700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:03.075532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:03.076287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 53/103] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:03.082457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:03.170830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 51/104] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:18:02 2022] POST /identity/v3/projects => generated 302 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:03.242878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849985f7-7372-44f3-80eb-427e420391dd None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:03.284146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:03.284826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:03.285138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:03.285414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:03.286078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:03.286421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:03.287810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:03.297858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 54/105] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:03.306215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:03.450636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a3df3-8e94-4bab-b660-8247344a5fb6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:03.466835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:03.492162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab75d9e-2113-45e3-98b8-9784dea17dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:03.492832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75d9e-2113-45e3-98b8-9784dea17dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:03.493206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75d9e-2113-45e3-98b8-9784dea17dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:03.493676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75d9e-2113-45e3-98b8-9784dea17dc5 None admin] PATH_INFO: `/v3/users/965a177f435644179df828529e192c63` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:03.514284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab75d9e-2113-45e3-98b8-9784dea17dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=965a177f435644179df828529e192c63)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:03.516537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab75d9e-2113-45e3-98b8-9784dea17dc5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:03.518921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 52/106] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:03 2022] GET /identity/v3/users/965a177f435644179df828529e192c63 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:03.524168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:03.556544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:03.660650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cf614-710c-4c2f-a214-5ff37da47363 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:03.697687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:03.698305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:03.698585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:03.698860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:03.785444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:03.786855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:03.812591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:03.900797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a241a04-3baa-46e6-a2ca-7b4bc482b59d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:03.901093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a241a04-3baa-46e6-a2ca-7b4bc482b59d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:03.901602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a241a04-3baa-46e6-a2ca-7b4bc482b59d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:03.903217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 53/107] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:18:03.909101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd06e-7d7a-44f8-9229-bd233016b4ee None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:03.909623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd06e-7d7a-44f8-9229-bd233016b4ee None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:03.910053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd06e-7d7a-44f8-9229-bd233016b4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:03.918885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 55/108] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:03.924592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:03.931759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ef9dd06e-7d7a-44f8-9229-bd233016b4ee None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:03.933382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ef9dd06e-7d7a-44f8-9229-bd233016b4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:04.055644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb37366-85b4-4a64-a64f-8dfae584ccc0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:04.068133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 54/109] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:04.069514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61450-f282-4aec-8c7a-99b503d8adfb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.069808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61450-f282-4aec-8c7a-99b503d8adfb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.070084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e61450-f282-4aec-8c7a-99b503d8adfb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.071330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 55/110] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:04.072457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373787-d57f-463e-a9fd-531ec5b5a737 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.072845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373787-d57f-463e-a9fd-531ec5b5a737 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.073160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373787-d57f-463e-a9fd-531ec5b5a737 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.074347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 56/111] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:04.075953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:04.079777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0d92c-c639-4f2a-8df5-e15729eba838 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.080062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0d92c-c639-4f2a-8df5-e15729eba838 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.080343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0d92c-c639-4f2a-8df5-e15729eba838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.103219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403ee35-e91c-4b9b-9d47-130ae59901ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:04.103860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ee35-e91c-4b9b-9d47-130ae59901ae None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.105749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ee35-e91c-4b9b-9d47-130ae59901ae None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.106106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ee35-e91c-4b9b-9d47-130ae59901ae None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.107430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0cb0d92c-c639-4f2a-8df5-e15729eba838 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:04.109964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403ee35-e91c-4b9b-9d47-130ae59901ae None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:04.114468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0cb0d92c-c639-4f2a-8df5-e15729eba838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:04.114567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403ee35-e91c-4b9b-9d47-130ae59901ae None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:04.116933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 56/112] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:03 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:04.118851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ce254-2dea-4c24-9100-649ca1f73de1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.119130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ce254-2dea-4c24-9100-649ca1f73de1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.119405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ce254-2dea-4c24-9100-649ca1f73de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.156187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-393ce254-2dea-4c24-9100-649ca1f73de1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:04.157780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-393ce254-2dea-4c24-9100-649ca1f73de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:04.239167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 57/113] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:04.239961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0d92c-c639-4f2a-8df5-e15729eba838 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:04.285206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:04.291184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 57/114] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:04.367604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0d92c-c639-4f2a-8df5-e15729eba838 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:04.410975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66c169-3c4b-451f-97a5-d0eebd47b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:04.411626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66c169-3c4b-451f-97a5-d0eebd47b182 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.411907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66c169-3c4b-451f-97a5-d0eebd47b182 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.412181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66c169-3c4b-451f-97a5-d0eebd47b182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.412943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66c169-3c4b-451f-97a5-d0eebd47b182 None admin] RBAC: Adding query filter params (role.id=005a2a7d431545da9ca179397edde797, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=965a177f435644179df828529e192c63) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:04.413288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66c169-3c4b-451f-97a5-d0eebd47b182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:04.414784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66c169-3c4b-451f-97a5-d0eebd47b182 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:04.422178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 58/115] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:04 2022] GET /identity/v3/role_assignments?user.id=965a177f435644179df828529e192c63&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=005a2a7d431545da9ca179397edde797 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:04.561287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ce254-2dea-4c24-9100-649ca1f73de1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:04.627395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523bad-198f-499a-8c78-cf9d575f12fb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.627679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523bad-198f-499a-8c78-cf9d575f12fb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.627868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523bad-198f-499a-8c78-cf9d575f12fb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.630434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 59/116] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:04.636709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea486-00da-44b0-a492-8029526db190 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.637278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea486-00da-44b0-a492-8029526db190 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.637564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea486-00da-44b0-a492-8029526db190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.662108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a87ea486-00da-44b0-a492-8029526db190 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:04.663358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a87ea486-00da-44b0-a492-8029526db190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:04.716060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ce254-2dea-4c24-9100-649ca1f73de1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:04.737450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:04.751871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 60/117] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:04.752569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea486-00da-44b0-a492-8029526db190 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:04.773271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:04.773922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.774207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.774484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.791250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:04.806263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:04.810833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:04.811805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 58/118] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:04.813427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:04.875453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea486-00da-44b0-a492-8029526db190 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:04.942976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:04.945061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:04.945350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:04.945679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:04.965308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:04.971656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:04.972487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 61/119] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:04.973667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.048270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ec5bc-91c2-4dad-a0d0-050a3b4f93d9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.065453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.081143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb8d42-7570-4a44-a627-5741401136bf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.096186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.097910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.098331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.098778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.111407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:05.117195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:05.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:05.118970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:05.119530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.119530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.119909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.120067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.120706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:05.121009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.121793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 59/120] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:05.122397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.123057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.136033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 62/121] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.137461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.178326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.258702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ed167-3d10-4bdc-862d-3c2696ef09c5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.258997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c20c3d-ad7e-42c3-924a-b3959a4f9217 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.297692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.298800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.299419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.299726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.300449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:05.300812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.302221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.305586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.306431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.306902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.307347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.316067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 60/122] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.317100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.321806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:05.328447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:05.329426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:05.330175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:05.332826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 63/123] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:05.333881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.347300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.440612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.444497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffe233-fa2f-444b-987c-daa4f33d7033 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.457373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bef548-ac3b-4a9a-83e9-71c285f68ab9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.482111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.482894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.483272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.484245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.484545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:05.484948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.486469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.497246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 61/124] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.498196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.506719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.507488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.508086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.508198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] PATH_INFO: `/v3/users/d133fe6374bc4975bb8873cbc865761e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.509555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] RBAC: Authorizing `identity:get_user(user_id=d133fe6374bc4975bb8873cbc865761e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.511078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.513211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 64/125] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/users/d133fe6374bc4975bb8873cbc865761e => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.514064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.598153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.622032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f05d5d-13c6-4559-bf9f-bafa75cf6a14 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.631785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cd39b-a8b0-4df3-8fa4-3012a2f6b989 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.667352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.668562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.669064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.669531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.669629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.670175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.670465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.670740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.671636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:05.672248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.672709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.674042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.674218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.675919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 62/126] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.681005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.683963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 65/127] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.685050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.716735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.798320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b518c4-fe93-4c91-9c12-e019a27065c8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.802966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18fed-e430-43cb-a19e-e01e80d4f88c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.835436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.836195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.836453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.836731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.837897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.839467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.841488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 63/128] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.842033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.842582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.844159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.844656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.845145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.849223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:05.851059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:05.853206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 66/129] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:05.854163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:05.871678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.957965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bb6a-2376-450b-88d6-ee7c3198abcb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.961347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:05.981592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb014e-04f1-4d4e-8b62-54ebb053981a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:05.995686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:05.996331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:05.996639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:05.997022 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:05.998285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.000694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.002582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 64/130] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:06.008196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:06.022475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:06.023620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.024154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.024599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.025979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.027585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.029967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 67/131] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:05 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:06.031427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:06.132518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:06.143158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf50c3-cfd0-44b0-929e-1aa6ac4d5e43 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:06.162756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf504b-e0ae-4ca1-8e2f-04010a41cb05 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:06.186654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:06.187907 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.188359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.188947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.190804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.192706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.195084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 65/132] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:06 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:06.195968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:06.207641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:06.208489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.209297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.209679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0/users/d133fe6374bc4975bb8873cbc865761e/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.212117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef95371881d74261aacce73d3647ecf0, user_id=d133fe6374bc4975bb8873cbc865761e, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.214447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.232728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:06.298074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237ad0-509c-467c-8363-d4e72c32c511 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:06.331006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:06.331710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.332071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.332310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0/users/2c7ddc5ee76a4a0f81bea1f3107dde6d/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.341359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 68/133] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:06 2022] PUT /identity/v3/projects/ef95371881d74261aacce73d3647ecf0/users/d133fe6374bc4975bb8873cbc865761e/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:06.341359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:06.342864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef95371881d74261aacce73d3647ecf0, user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d, role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.345162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.419740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 66/134] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:06 2022] PUT /identity/v3/projects/ef95371881d74261aacce73d3647ecf0/users/2c7ddc5ee76a4a0f81bea1f3107dde6d/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:06.420599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:06.466449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fed74-656a-4b12-a0bb-3d80fbbbf9a2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:06.510674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c4cfc-d566-4c8f-a40c-1d3b0b35e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:06.511428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4cfc-d566-4c8f-a40c-1d3b0b35e97f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.511787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4cfc-d566-4c8f-a40c-1d3b0b35e97f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.512140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4cfc-d566-4c8f-a40c-1d3b0b35e97f None admin] PATH_INFO: `/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.513453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c4cfc-d566-4c8f-a40c-1d3b0b35e97f None admin] RBAC: Authorizing `identity:get_project(project_id=ccfaa2e28bbf4fd897ff5ae41e104f3c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.515542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c4cfc-d566-4c8f-a40c-1d3b0b35e97f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.518360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 69/135] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:06 2022] GET /identity/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:06.519815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e42e5-97b5-49e3-9c8c-8824813dad97 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.520182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e42e5-97b5-49e3-9c8c-8824813dad97 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.520535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e42e5-97b5-49e3-9c8c-8824813dad97 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.525140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 70/136] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:06.526044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e42e5-97b5-49e3-9c8c-8824813dad97 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:06.530396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:06.585437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:06.606130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e88c-aade-4dcc-b66f-709e00736d87 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:06.655032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf875e95-8e9c-4368-bd4d-ddafab86ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:06.655871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf875e95-8e9c-4368-bd4d-ddafab86ae64 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.656176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf875e95-8e9c-4368-bd4d-ddafab86ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.656535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf875e95-8e9c-4368-bd4d-ddafab86ae64 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0/users/2c7ddc5ee76a4a0f81bea1f3107dde6d/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.658600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf875e95-8e9c-4368-bd4d-ddafab86ae64 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef95371881d74261aacce73d3647ecf0, user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.660155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf875e95-8e9c-4368-bd4d-ddafab86ae64 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.700336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e42e5-97b5-49e3-9c8c-8824813dad97 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:06.728896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 67/137] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:06 2022] PUT /identity/v3/projects/ef95371881d74261aacce73d3647ecf0/users/2c7ddc5ee76a4a0f81bea1f3107dde6d/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:06.730679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eece47-9dbe-46a8-b637-4336e6af3fb8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.731167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eece47-9dbe-46a8-b637-4336e6af3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.731729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eece47-9dbe-46a8-b637-4336e6af3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.740833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad3f9c-5837-40a0-b280-f9b2bfad0d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:06.742838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad3f9c-5837-40a0-b280-f9b2bfad0d96 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.742960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad3f9c-5837-40a0-b280-f9b2bfad0d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.743186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad3f9c-5837-40a0-b280-f9b2bfad0d96 None admin] PATH_INFO: `/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c/users/2c7ddc5ee76a4a0f81bea1f3107dde6d/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.745305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad3f9c-5837-40a0-b280-f9b2bfad0d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfaa2e28bbf4fd897ff5ae41e104f3c, user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:06.746897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad3f9c-5837-40a0-b280-f9b2bfad0d96 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:06.757192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-95eece47-9dbe-46a8-b637-4336e6af3fb8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:06.758935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-95eece47-9dbe-46a8-b637-4336e6af3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:06.824315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 71/138] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:06 2022] PUT /identity/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c/users/2c7ddc5ee76a4a0f81bea1f3107dde6d/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:06.861145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 68/139] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:06.961416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646dbbe-b363-4f89-ac68-37963e392fe3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.961416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646dbbe-b363-4f89-ac68-37963e392fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.961675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646dbbe-b363-4f89-ac68-37963e392fe3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.963278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 72/140] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:06.969567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10bc6-4e13-4831-8111-551a30d3d9fc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:06.969870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10bc6-4e13-4831-8111-551a30d3d9fc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:06.970141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10bc6-4e13-4831-8111-551a30d3d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:06.993865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b9d10bc6-4e13-4831-8111-551a30d3d9fc None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:06.995088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b9d10bc6-4e13-4831-8111-551a30d3d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:07.087655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 69/141] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:07.227136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646dbbe-b363-4f89-ac68-37963e392fe3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:07.301891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:07.352847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646dbbe-b363-4f89-ac68-37963e392fe3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:07.389349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:07.390673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:07.391008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:07.391268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:07.392445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:07.393947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:07.395614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 73/142] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:07.401176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10bc6-4e13-4831-8111-551a30d3d9fc None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:07.402603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:07.429729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:07.605504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10bc6-4e13-4831-8111-551a30d3d9fc None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:07.626880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8663-4181-46d6-9af0-1be608556d01 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:07.674723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:07.676122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:07.676598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:07.677115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:07.677973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:07.679925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:07.695207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:07.722636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:07.723299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:07.723582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:07.723856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:07.741889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:07.746676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:07.747498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:07.748239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 74/143] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:07.755386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:07.825755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 70/144] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:07 2022] POST /identity/v3/users => generated 283 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:07.896003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f865905-4f31-464a-9363-5f6dc4f29358 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:07.941558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:07.942200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:07.942477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:07.942746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:07.943467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:07.943777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:07.945186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:07.960702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 75/145] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:07.966658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:08.079058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:08.124006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53b9e3-f3d4-4e05-820d-8658a307193c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:08.162538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:08.163504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:08.163973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:08.164432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] PATH_INFO: `/v3/users/965a177f435644179df828529e192c63` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:08.165855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] RBAC: Authorizing `identity:get_user(user_id=965a177f435644179df828529e192c63)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:08.167482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:08.169286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 71/146] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:07 2022] GET /identity/v3/users/965a177f435644179df828529e192c63 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:08.175571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:08.256881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:08.310910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9587-0294-48e2-b67c-9c09a5985d41 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:08.353816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ded46-fa4a-43ad-9074-dfe026cfe289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:08.354468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ded46-fa4a-43ad-9074-dfe026cfe289 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:08.354748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ded46-fa4a-43ad-9074-dfe026cfe289 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:08.355023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ded46-fa4a-43ad-9074-dfe026cfe289 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:08.356161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ded46-fa4a-43ad-9074-dfe026cfe289 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:08.357710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ded46-fa4a-43ad-9074-dfe026cfe289 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:08.359538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 76/147] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:08 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:08.365642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:08.491181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35665397-099f-48eb-afd4-5489f0bdefb5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:08.534656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2627ee-65c3-43eb-bc28-2779f5f194c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:08.535677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2627ee-65c3-43eb-bc28-2779f5f194c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:08.536148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2627ee-65c3-43eb-bc28-2779f5f194c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:08.536609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2627ee-65c3-43eb-bc28-2779f5f194c3 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0/users/965a177f435644179df828529e192c63/roles/005a2a7d431545da9ca179397edde797` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:08.538735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2627ee-65c3-43eb-bc28-2779f5f194c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef95371881d74261aacce73d3647ecf0, user_id=965a177f435644179df828529e192c63, role_id=005a2a7d431545da9ca179397edde797)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:08.540510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2627ee-65c3-43eb-bc28-2779f5f194c3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:08.545857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:08.621858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 72/148] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:08 2022] PUT /identity/v3/projects/ef95371881d74261aacce73d3647ecf0/users/965a177f435644179df828529e192c63/roles/005a2a7d431545da9ca179397edde797 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:09.189372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e209-d777-4591-84c9-562d1ef98244 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:09.189707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e209-d777-4591-84c9-562d1ef98244 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:09.189822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e209-d777-4591-84c9-562d1ef98244 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:09.191184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 77/149] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:09.196668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30776-978d-40f7-8835-854e8bf719d0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:09.197207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30776-978d-40f7-8835-854e8bf719d0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:09.197693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30776-978d-40f7-8835-854e8bf719d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:09.221776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-18f30776-978d-40f7-8835-854e8bf719d0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:09.223279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-18f30776-978d-40f7-8835-854e8bf719d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:09.311576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 73/150] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:09.842103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1e209-d777-4591-84c9-562d1ef98244 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:09.977845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1e209-d777-4591-84c9-562d1ef98244 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:10.001447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.012712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:10.015671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.015671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.015671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.020130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7158-818f-4429-b7ff-9f99db4146c3 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.020607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7158-818f-4429-b7ff-9f99db4146c3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.020687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7158-818f-4429-b7ff-9f99db4146c3 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.022029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 74/151] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:10.029517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:10.035485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:10.036599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:10.037924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:10.042498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1c20-4259-4920-824c-c3c1b2143cb6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.042779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1c20-4259-4920-824c-c3c1b2143cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.043051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1c20-4259-4920-824c-c3c1b2143cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.054050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 78/152] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:10.057405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:10.076486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-aabd1c20-4259-4920-824c-c3c1b2143cb6 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:10.078464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-aabd1c20-4259-4920-824c-c3c1b2143cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:10.216871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 75/153] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:10.234416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcea9-efc4-4cdb-b2f7-d5c9147dbd14 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:10.279110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:10.279752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.280035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.280370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.281620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:10.281924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:10.283365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:10.293532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 79/154] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:10.299461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd1c20-4259-4920-824c-c3c1b2143cb6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:10.358259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.410056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd1c20-4259-4920-824c-c3c1b2143cb6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:10.460040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1aa09-b6b4-43ab-a63d-033d5f43c0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:10.460682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1aa09-b6b4-43ab-a63d-033d5f43c0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.461018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1aa09-b6b4-43ab-a63d-033d5f43c0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.461316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1aa09-b6b4-43ab-a63d-033d5f43c0c8 None admin] PATH_INFO: `/v3/users/d133fe6374bc4975bb8873cbc865761e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.462461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1aa09-b6b4-43ab-a63d-033d5f43c0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=d133fe6374bc4975bb8873cbc865761e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:10.463918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1aa09-b6b4-43ab-a63d-033d5f43c0c8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:10.465694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 76/155] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:10 2022] GET /identity/v3/users/d133fe6374bc4975bb8873cbc865761e => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:10.471646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:10.532026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.582482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfe173-731e-42eb-b349-d29e1632398a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.582792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfe173-731e-42eb-b349-d29e1632398a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.583032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfe173-731e-42eb-b349-d29e1632398a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.584387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 77/156] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:10.590281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b66e7-6664-4854-9681-cbb85adb915b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.590568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b66e7-6664-4854-9681-cbb85adb915b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.590827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b66e7-6664-4854-9681-cbb85adb915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.602003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b40fb-9ea0-4919-aa7c-4bb70b31e91c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:10.634125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-546b66e7-6664-4854-9681-cbb85adb915b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:10.635349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-546b66e7-6664-4854-9681-cbb85adb915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:10.639471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc59aaf-9316-40e2-9058-d4c47b2118d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:10.640727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc59aaf-9316-40e2-9058-d4c47b2118d8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.641008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc59aaf-9316-40e2-9058-d4c47b2118d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.641305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc59aaf-9316-40e2-9058-d4c47b2118d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.712147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc59aaf-9316-40e2-9058-d4c47b2118d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:10.713670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc59aaf-9316-40e2-9058-d4c47b2118d8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:10.762836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.844050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 80/157] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:10.845370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf53b-08a3-44b3-8266-0cf0d82c7dbd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.846520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf53b-08a3-44b3-8266-0cf0d82c7dbd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.846520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf53b-08a3-44b3-8266-0cf0d82c7dbd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.846702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 78/158] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:10.847551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 81/159] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:10.854053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b66e7-6664-4854-9681-cbb85adb915b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:10.854840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce18660-08f0-4ad1-8270-4eb7f677bc23 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:10.855125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce18660-08f0-4ad1-8270-4eb7f677bc23 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:10.855399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce18660-08f0-4ad1-8270-4eb7f677bc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:10.882807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3ce18660-08f0-4ad1-8270-4eb7f677bc23 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:10.883999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3ce18660-08f0-4ad1-8270-4eb7f677bc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:10.969416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.996692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 82/160] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:10.996692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce18660-08f0-4ad1-8270-4eb7f677bc23 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:11.059274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b66e7-6664-4854-9681-cbb85adb915b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:11.107196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:11.146315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce18660-08f0-4ad1-8270-4eb7f677bc23 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:11.157997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:11.159055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:11.159547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:11.160029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:11.165739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:11.167464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:11.169387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 79/161] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:10 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:11.185610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:11.193744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:11.194385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:11.194664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:11.194935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:11.206230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:11.213394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:11.214377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:11.215724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 83/162] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:11.220703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:11.327724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025f55-07c4-4754-9aae-ef1e32dd92ac None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:11.356772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:11.361735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:11.362351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:11.362627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:11.362896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:11.363565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:11.363869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:11.369077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:11.374703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 84/163] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:11.381836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:11.388064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094816d-4db9-4e3d-a7e1-8e6894619546 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:11.426047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:11.452806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:11.453838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:11.454339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:11.455619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:11.456568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=d133fe6374bc4975bb8873cbc865761e) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:11.457110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:11.459033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:11.469023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 80/164] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:11 2022] GET /identity/v3/role_assignments?user.id=d133fe6374bc4975bb8873cbc865761e&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:11.470339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:11.502439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94df6d4-d3c1-4c5e-9ce4-a20fb2855dd9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:11.546466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:11.547115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:11.547413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:11.547649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:11.548860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:11.550447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:11.552163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 85/165] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:11 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:11.561061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:11.664845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db4979-fba7-4f57-9da5-3dd977109e40 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:11.687245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:11.742314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:11.743044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:11.743328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:11.743600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:11.760251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c503-07e3-4615-8092-b3063b0c24dc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:11.770777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:11.780773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:11.781736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:11.783212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 81/166] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:11.789286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:11.834350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:11.834973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:11.835250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:11.835519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:11.908233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:11.943537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:11.945638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:12.012776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f84d39-e188-49a1-8b85-ea357c37aef8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:12.069403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:12.076753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:12.077541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:12.077757 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:12.078035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:12.078708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:12.079010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:12.080423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:12.094450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 82/167] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:12.095077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:12.135382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 86/168] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:12.136238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:12.265990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e91f-4c4f-4db7-a0a3-ea2750a174f6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:12.294275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd591-3c95-4917-8155-009800efed79 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:12.306269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:12.334354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:12.335124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:12.335405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:12.335680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:12.337057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:12.338077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:12.338548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:12.338745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:12.338976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:12.339245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:12.340358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 87/169] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:12 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:12.340929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:12.357663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:12.363666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:12.364553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:12.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 83/170] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:12.369959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:12.394742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:12.505790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67fa0d-7436-4845-a35e-031058701f27 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:12.549848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:12.550409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:12.550685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:12.550963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:12.552090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:12.553564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:12.555500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 88/171] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:12 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:12.556273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:12.598684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f88e1-3661-4c70-806c-d24c86e0d987 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:12.676739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:12.682602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981289b7-1ba1-4bce-a6e6-693e524c97cf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:12.693423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ec72a-24e0-4a18-b620-9f9c4ea679a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:12.696236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ec72a-24e0-4a18-b620-9f9c4ea679a9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:12.696236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ec72a-24e0-4a18-b620-9f9c4ea679a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:12.696236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ec72a-24e0-4a18-b620-9f9c4ea679a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:12.750034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:12.750829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:12.751109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:12.751381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:12.752066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:12.752371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:12.753765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:12.761413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:12.773872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 89/172] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:12.774729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:12.830960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ec72a-24e0-4a18-b620-9f9c4ea679a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:12.832376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ec72a-24e0-4a18-b620-9f9c4ea679a9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:12.944720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff311e-3436-420c-a22e-d86013b1b0cb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:13.015059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:13.015677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.015955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.016231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.016963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:13.017295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:13.018732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:13.029873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 84/173] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:13.031411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1fa35-c567-4a62-90d6-49ec469b1897 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.031705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1fa35-c567-4a62-90d6-49ec469b1897 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.031823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 90/174] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:12 2022] GET /identity/v3/role_assignments?user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:13.031986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1fa35-c567-4a62-90d6-49ec469b1897 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.032571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:13.037564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 85/175] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:13.041826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1fa35-c567-4a62-90d6-49ec469b1897 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:13.077976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:13.169498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:13.200361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2980147-d035-4d17-b2a8-27157022580f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:13.244653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18e552-5780-4afa-ade9-a31324326b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:13.245380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e552-5780-4afa-ade9-a31324326b7d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.245715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e552-5780-4afa-ade9-a31324326b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.245997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e552-5780-4afa-ade9-a31324326b7d None admin] PATH_INFO: `/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.247276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18e552-5780-4afa-ade9-a31324326b7d None admin] RBAC: Authorizing `identity:get_user(user_id=2c7ddc5ee76a4a0f81bea1f3107dde6d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:13.248855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18e552-5780-4afa-ade9-a31324326b7d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:13.251610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 91/176] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:13 2022] GET /identity/v3/users/2c7ddc5ee76a4a0f81bea1f3107dde6d => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:13.252894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46ce5-043f-455a-a90d-387be6b7695a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.253273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46ce5-043f-455a-a90d-387be6b7695a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.253700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46ce5-043f-455a-a90d-387be6b7695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.258329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1fa35-c567-4a62-90d6-49ec469b1897 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:13.273240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-13e46ce5-043f-455a-a90d-387be6b7695a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:13.274507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-13e46ce5-043f-455a-a90d-387be6b7695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:13.327484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52760d-3e4c-4975-b52d-88a94cf437ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:13.328332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52760d-3e4c-4975-b52d-88a94cf437ae None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.328613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52760d-3e4c-4975-b52d-88a94cf437ae None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.328885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52760d-3e4c-4975-b52d-88a94cf437ae None admin] PATH_INFO: `/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.330206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52760d-3e4c-4975-b52d-88a94cf437ae None admin] RBAC: Authorizing `identity:get_project(project_id=ccfaa2e28bbf4fd897ff5ae41e104f3c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:13.331652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52760d-3e4c-4975-b52d-88a94cf437ae None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:13.333356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 86/177] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:13 2022] GET /identity/v3/projects/ccfaa2e28bbf4fd897ff5ae41e104f3c => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:13.334478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e097f-c565-4d62-903b-42c995e8f182 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.334752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e097f-c565-4d62-903b-42c995e8f182 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.335016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e097f-c565-4d62-903b-42c995e8f182 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.336231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 87/178] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:13.336935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e097f-c565-4d62-903b-42c995e8f182 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:13.349635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 92/179] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:13.351164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900fe12-e651-47eb-b216-0b233e74dc11 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.352363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900fe12-e651-47eb-b216-0b233e74dc11 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.352638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900fe12-e651-47eb-b216-0b233e74dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.374934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5900fe12-e651-47eb-b216-0b233e74dc11 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:13.376396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5900fe12-e651-47eb-b216-0b233e74dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:13.394981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:13.456860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 93/180] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:13.458317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900fe12-e651-47eb-b216-0b233e74dc11 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:13.489065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e097f-c565-4d62-903b-42c995e8f182 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:13.539705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5e219-3595-407e-bd76-d178409c5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:13.540557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5e219-3595-407e-bd76-d178409c5d35 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.541760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5e219-3595-407e-bd76-d178409c5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.542197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5e219-3595-407e-bd76-d178409c5d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.550777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:13.628132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900fe12-e651-47eb-b216-0b233e74dc11 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:13.654367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5e219-3595-407e-bd76-d178409c5d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:13.656580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5e219-3595-407e-bd76-d178409c5d35 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:13.677501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083d374-5035-4378-98d4-ac96f15ffd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:13.678170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083d374-5035-4378-98d4-ac96f15ffd47 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.678450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083d374-5035-4378-98d4-ac96f15ffd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.678720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083d374-5035-4378-98d4-ac96f15ffd47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.679506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083d374-5035-4378-98d4-ac96f15ffd47 None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=ccfaa2e28bbf4fd897ff5ae41e104f3c, user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:13.679817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083d374-5035-4378-98d4-ac96f15ffd47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:13.681360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083d374-5035-4378-98d4-ac96f15ffd47 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:13.688005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 94/181] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:13 2022] GET /identity/v3/role_assignments?user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d&scope.project.id=ccfaa2e28bbf4fd897ff5ae41e104f3c&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:13.689195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1fd9-5ff4-4975-a06a-9a35bcb5777d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.689750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1fd9-5ff4-4975-a06a-9a35bcb5777d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.689750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1fd9-5ff4-4975-a06a-9a35bcb5777d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.690920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 95/182] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:13.694371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d21d6-fdc8-434f-ac3a-6bcf0173b87c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.696075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d21d6-fdc8-434f-ac3a-6bcf0173b87c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.696350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d21d6-fdc8-434f-ac3a-6bcf0173b87c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.697785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 96/183] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:13.698537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d21d6-fdc8-434f-ac3a-6bcf0173b87c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:13.737446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:13.800157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 88/184] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:13.801841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63732-d096-447e-8798-aba2734bbfd4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.802328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63732-d096-447e-8798-aba2734bbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.802820 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63732-d096-447e-8798-aba2734bbfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.823797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-44d63732-d096-447e-8798-aba2734bbfd4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:13.824807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d21d6-fdc8-434f-ac3a-6bcf0173b87c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:13.825647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-44d63732-d096-447e-8798-aba2734bbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:13.862978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:13.869805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142f459-1a7a-4b38-a327-77b498f04908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:13.870456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142f459-1a7a-4b38-a327-77b498f04908 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.870737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142f459-1a7a-4b38-a327-77b498f04908 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.871010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142f459-1a7a-4b38-a327-77b498f04908 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.883150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142f459-1a7a-4b38-a327-77b498f04908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b142f459-1a7a-4b38-a327-77b498f04908 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:13.888043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:13.888892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:13.890054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 97/185] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:13.890707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c567-0744-48ae-93e8-5380ef320b86 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:13.890860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c567-0744-48ae-93e8-5380ef320b86 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:13.891136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c567-0744-48ae-93e8-5380ef320b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:13.908391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 89/186] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:13.909239 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d63732-d096-447e-8798-aba2734bbfd4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:13.910930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-abf8c567-0744-48ae-93e8-5380ef320b86 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:13.912152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-abf8c567-0744-48ae-93e8-5380ef320b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:13.996712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 98/187] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:13.997385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c567-0744-48ae-93e8-5380ef320b86 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.007024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.045371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d63732-d096-447e-8798-aba2734bbfd4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.096501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.097173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.097452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.097717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.111206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:14.116232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:14.117130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:14.118007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:14.119201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c567-0744-48ae-93e8-5380ef320b86 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.122380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 90/188] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:14.123069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.151972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.166239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.166941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.167220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.167490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.169086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.171156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.173810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 99/189] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:13 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.177916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.237115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72842d5-dde7-4b94-9a42-491d4c297ab9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.262938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.272033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.272645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.272929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.273296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.273891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:14.274194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.275582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.284541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 91/190] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.285316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.294050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3653de3-9131-4470-9327-ebe8946209ef None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.329131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.329743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.330019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.330289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.330953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:14.331258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.332616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.340456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 100/191] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.341976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.378409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.390217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7477-101a-4f5d-a7e6-37465ad9d0e8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.422920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.423527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.423806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.424077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.424827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] RBAC: Adding query filter params (role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:14.425162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.426618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.445059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 92/192] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/role_assignments?user.id=2c7ddc5ee76a4a0f81bea1f3107dde6d&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.445059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.445323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3e3c-de82-4721-8614-56a30c7375e4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.481024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.481712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.481988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.482260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.486125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.496965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:14.502669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:14.503789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 101/193] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:14.504890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.562004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b910ce-167b-4cc9-babe-aeaea2137fbb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.597912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.598561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.598846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.599118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] PATH_INFO: `/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.614964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.616356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.618601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 93/194] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.618721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.625766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f5da-4355-4102-bb1e-7e38dbf5147f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.634148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.662016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.662670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.663335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.663335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.664399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.666618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.667437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 102/195] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.668231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.741952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c897-0439-4665-8fcb-3180cdc6b571 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.742146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.775714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.776378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.776661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.776939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] PATH_INFO: `/v3/users/965a177f435644179df828529e192c63` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.778115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] RBAC: Authorizing `identity:get_user(user_id=965a177f435644179df828529e192c63)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.779099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec440-cf7d-45b5-ba5f-bdf4ba3d9725 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.779563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.781252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 94/196] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/users/965a177f435644179df828529e192c63 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.782098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.818534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.819056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.819338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.819611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.820274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:14.820580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.821966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.830054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 103/197] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:14.830646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:14.870177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.892569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900b72-bfe4-4212-9a0c-134afbb3e860 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.925823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.926420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.926699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.926962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.933367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a311f-2a5e-4b2c-854e-71efb1eb9a67 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:14.963549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.971979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:14.972580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:14.972858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:14.973163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:14.973807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.975239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:14.993495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:14.994955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:15.068824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:15.081332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 104/198] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:14 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:15.082167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.100250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 95/199] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:15.101383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.199891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aec3dd-33b9-4b61-9ba9-1dbfd2411bf7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:15.208823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2d68-8e20-42a6-80c6-b4cdf925905e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:15.239467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:15.240098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:15.240379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:15.240658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:15.248329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:15.249667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:15.250021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:15.250540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] PATH_INFO: `/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:15.252288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:15.255077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:15.260829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 96/200] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:15.260829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.303052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:15.318605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:15.325122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:15.325122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:15.386462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42c39f-45b6-4197-99b9-966581d7c283 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:15.426704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:15.427331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:15.427603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:15.427876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:15.429007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:15.430495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:15.432276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 97/201] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:15.434180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.452543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 105/202] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:15.453545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.555847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bf7f6-a500-4acc-ae9f-34d8af4e28a5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:15.561913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:15.574848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:15.584722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6ef6-b4d9-41f4-9938-9c1b5dd06334 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:15.603549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:15.604317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:15.604595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:15.604864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:15.623218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491035a-9951-492d-bcda-88493101caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:15.624804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491035a-9951-492d-bcda-88493101caef None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:15.625312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491035a-9951-492d-bcda-88493101caef None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:15.625796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491035a-9951-492d-bcda-88493101caef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:15.626702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491035a-9951-492d-bcda-88493101caef None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:15.627109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491035a-9951-492d-bcda-88493101caef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:15.628722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491035a-9951-492d-bcda-88493101caef None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:15.635548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 106/203] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/role_assignments?user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:15.641319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491035a-9951-492d-bcda-88493101caef None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.734760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:15.736291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:15.804468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491035a-9951-492d-bcda-88493101caef None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:15.864008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:15.864581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:15.864855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:15.865158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:15.868963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:15.870457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:15.872320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 107/204] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:15.879075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.899123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:15.930318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 98/205] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:15.939392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:15.973293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:16.069193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f298-8d9e-4f2a-86ca-4c05aaad0114 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:16.094217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59049-b7a0-4fb7-9e4f-785d1bc8f9ae None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:16.143575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:16.144542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:16.145024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:16.145527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:16.146941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:16.148604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:16.151504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 99/206] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:16.158174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:16.165192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133560f-4df5-4ae3-9ef1-94b3f3e939eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:16.165816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133560f-4df5-4ae3-9ef1-94b3f3e939eb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:16.166101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133560f-4df5-4ae3-9ef1-94b3f3e939eb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:16.166374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133560f-4df5-4ae3-9ef1-94b3f3e939eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:16.167117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133560f-4df5-4ae3-9ef1-94b3f3e939eb None admin] RBAC: Adding query filter params (role.id=005a2a7d431545da9ca179397edde797, scope.project.id=ef95371881d74261aacce73d3647ecf0, user.id=965a177f435644179df828529e192c63) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:16.167425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133560f-4df5-4ae3-9ef1-94b3f3e939eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:16.168885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133560f-4df5-4ae3-9ef1-94b3f3e939eb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:16.183595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 108/207] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:15 2022] GET /identity/v3/role_assignments?user.id=965a177f435644179df828529e192c63&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=005a2a7d431545da9ca179397edde797 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:16.305060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:16.323950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0c3b3-0bd5-470e-9165-b50b7ae6aa57 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:16.370948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953a4a9-79b1-4c07-8248-fbb3d04e793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:16.371626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a4a9-79b1-4c07-8248-fbb3d04e793c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:16.371906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a4a9-79b1-4c07-8248-fbb3d04e793c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:16.372173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a4a9-79b1-4c07-8248-fbb3d04e793c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:16.372914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953a4a9-79b1-4c07-8248-fbb3d04e793c None admin] RBAC: Adding query filter params (role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:16.373243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953a4a9-79b1-4c07-8248-fbb3d04e793c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:16.375320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953a4a9-79b1-4c07-8248-fbb3d04e793c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:16.383302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 100/208] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:16 2022] GET /identity/v3/role_assignments?user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:17.615789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abbb20-05e6-4fb4-9f39-4bc25c1ebd23 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:17.616801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abbb20-05e6-4fb4-9f39-4bc25c1ebd23 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:17.617339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abbb20-05e6-4fb4-9f39-4bc25c1ebd23 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:17.618886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 109/209] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:17.625298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f59dbb-1f5c-4de1-931b-2faf21e0677e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:17.626140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f59dbb-1f5c-4de1-931b-2faf21e0677e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:17.626614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f59dbb-1f5c-4de1-931b-2faf21e0677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:17.645961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b4f59dbb-1f5c-4de1-931b-2faf21e0677e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:17.647476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b4f59dbb-1f5c-4de1-931b-2faf21e0677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:17.665006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce1a8-19e1-40bc-8d28-fb3389410094 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:17.665337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce1a8-19e1-40bc-8d28-fb3389410094 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:17.665590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce1a8-19e1-40bc-8d28-fb3389410094 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:17.666949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 110/210] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:17.674144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c731834-d75c-405c-9624-36675c765ee4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:17.674427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c731834-d75c-405c-9624-36675c765ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:17.674705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c731834-d75c-405c-9624-36675c765ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:17.693765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4c731834-d75c-405c-9624-36675c765ee4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:17.694964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4c731834-d75c-405c-9624-36675c765ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:17.721421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 101/211] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:17.767093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 111/212] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:17.999799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f59dbb-1f5c-4de1-931b-2faf21e0677e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.031195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b57b-ae4d-4281-b2ea-9a7fc6165138 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.031529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b57b-ae4d-4281-b2ea-9a7fc6165138 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.031767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b57b-ae4d-4281-b2ea-9a7fc6165138 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.033406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 112/213] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:18.038397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b126980-0870-4c2f-8298-3cad9ef0b249 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.038909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b126980-0870-4c2f-8298-3cad9ef0b249 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.039406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b126980-0870-4c2f-8298-3cad9ef0b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.060601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1b126980-0870-4c2f-8298-3cad9ef0b249 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:18.062178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1b126980-0870-4c2f-8298-3cad9ef0b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:18.064671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:18.080891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:18.105193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f59dbb-1f5c-4de1-931b-2faf21e0677e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.141154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.141804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 113/214] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:18.141915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.142129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.142404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.143615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:18.145260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:18.146019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b126980-0870-4c2f-8298-3cad9ef0b249 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.146990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 102/215] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:18.152244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.259653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b126980-0870-4c2f-8298-3cad9ef0b249 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.290681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464d136-973b-436d-ae63-123ad3c390e1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.296547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.297453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.297928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.298411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.306558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:18.311684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:18.317282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:18.324200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:18.324971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:18.326065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 114/216] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:18.327754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.333008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.333681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.333962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.334235 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.334895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:18.336339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:18.417273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:18.429073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 103/217] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:18 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:18:18.429073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.437737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd564b-1912-4801-9a38-02801f8d3351 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.476949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.477836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.478265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.478714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.479553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:18.480006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:18.481574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:18.492485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 115/218] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:18.498525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.577518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871a71-e0c2-4e24-b515-1a7e6730426b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.593566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:18.631740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.632405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.632900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.633215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.642320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ccf09-3223-49f9-8b4d-06a63851b416 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.644551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:18.650766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:18.651697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:18.652497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 104/219] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:18.660780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.690754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd304080-627d-4cf1-8dd9-463dd41f1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.690754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd304080-627d-4cf1-8dd9-463dd41f1af7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.690754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd304080-627d-4cf1-8dd9-463dd41f1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.690754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd304080-627d-4cf1-8dd9-463dd41f1af7 None admin] PATH_INFO: `/v3/users/c83625dbe91f4e68a34cb295159893be` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.706157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd304080-627d-4cf1-8dd9-463dd41f1af7 None admin] RBAC: Authorizing `identity:get_user(user_id=c83625dbe91f4e68a34cb295159893be)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:18.707625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd304080-627d-4cf1-8dd9-463dd41f1af7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:18.709494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 116/220] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:18 2022] GET /identity/v3/users/c83625dbe91f4e68a34cb295159893be => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:18.710507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401ebf-cd6b-42b6-a578-3be7e1e648c9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.710791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401ebf-cd6b-42b6-a578-3be7e1e648c9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.711066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401ebf-cd6b-42b6-a578-3be7e1e648c9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.712379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 117/221] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:18.717200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29401ebf-cd6b-42b6-a578-3be7e1e648c9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:18.737333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:18.791425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4b2cc-4974-47ee-bfd7-e99dc1ee9c0a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.838501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce5730-10f1-44be-a1d4-0f3bfd7a67d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.838501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5730-10f1-44be-a1d4-0f3bfd7a67d9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.838915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5730-10f1-44be-a1d4-0f3bfd7a67d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.840184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce5730-10f1-44be-a1d4-0f3bfd7a67d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.840184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5730-10f1-44be-a1d4-0f3bfd7a67d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:18.840435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5730-10f1-44be-a1d4-0f3bfd7a67d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:18.842948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce5730-10f1-44be-a1d4-0f3bfd7a67d9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:18.852920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 105/222] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:18.854033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc643a1-9b7d-432a-b983-038ca447f70b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.854321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc643a1-9b7d-432a-b983-038ca447f70b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.854603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc643a1-9b7d-432a-b983-038ca447f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.869342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29401ebf-cd6b-42b6-a578-3be7e1e648c9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:18.882103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-afc643a1-9b7d-432a-b983-038ca447f70b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:18.883305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-afc643a1-9b7d-432a-b983-038ca447f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:18.895541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:18.917927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:18.919200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:18.919943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:18.920992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:18.972455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 106/223] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:18.972870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc643a1-9b7d-432a-b983-038ca447f70b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.012344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:19.014269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:19.120747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:19.134878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 118/224] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:19.146406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.167350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:19.218150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc643a1-9b7d-432a-b983-038ca447f70b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:19.266331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:19.266976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:19.267250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:19.267517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] PATH_INFO: `/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:19.270331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:19.271780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:19.277619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 107/225] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:18 2022] GET /identity/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:19.283755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.305449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb5745-a28b-4e7c-95f0-ebc0f63a8644 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:19.344373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:19.345132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:19.345414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:19.345686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:19.346954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:19.348487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:19.350302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 119/226] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:19 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:19.351313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.395597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1a555-ec32-4d78-ae65-461cf4fdf7e2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:19.416764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:19.432010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:19.432646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:19.432921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:19.433222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:19.442338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:19.442338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:19.442338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 108/227] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:19 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:19.442338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.446076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:19.462955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1f22-1505-4bdd-ab61-1e3374d085fd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:19.501872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:19.502498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:19.502777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:19.503050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:19.514128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:19.519500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:19.520351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:19.521163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:19.525656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 120/228] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:19.526493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.553235 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084eb9e-a3df-407d-95f4-0163a39dfa76 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:19.601237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:19.601882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:19.602169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:19.602436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:19.603175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=c83625dbe91f4e68a34cb295159893be) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:19.603484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:19.604926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:19.614429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 109/229] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:19 2022] GET /identity/v3/role_assignments?user.id=c83625dbe91f4e68a34cb295159893be&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:19.615511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.673426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29bcd6-f041-4cd7-bd7a-f1bdb89f8d25 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:19.739766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:19.741995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:19.742677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:19.742956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:19.743227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284/users/eb4a7d0f20ce4e15ba3e1acd54cc113d/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:19.745285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39e588d6aea463c98420ad4b9124284, user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:19.746880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:19.806315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3748028-2849-498b-8453-6f1ddc6e0ce5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:19.853194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 121/230] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:19 2022] PUT /identity/v3/projects/d39e588d6aea463c98420ad4b9124284/users/eb4a7d0f20ce4e15ba3e1acd54cc113d/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:19.854631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:19.855330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:19.856115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:19.856404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:19.857164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:19.866688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:19.866688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:19.872003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 110/231] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:19.878735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:19.888662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:20.021233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385c86-273b-43cf-a259-1071abc41291 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:20.077257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:20.077980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:20.078266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:20.078543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] PATH_INFO: `/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:20.081237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] RBAC: Authorizing `identity:get_user(user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:20.082793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:20.084784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 122/232] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:19 2022] GET /identity/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:20.090241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:20.202926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef515c-dd25-4c6e-a872-51381e6d7e18 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:20.217761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:20.240746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a2a07-e29a-4da2-b09c-e6121d11b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:20.241466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2a07-e29a-4da2-b09c-e6121d11b674 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:20.241742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2a07-e29a-4da2-b09c-e6121d11b674 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:20.242011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2a07-e29a-4da2-b09c-e6121d11b674 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:20.243141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2a07-e29a-4da2-b09c-e6121d11b674 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:20.245088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2a07-e29a-4da2-b09c-e6121d11b674 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:20.247132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 111/233] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:20 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:20.253544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:20.363540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:20.394784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1fc02-5478-4961-a7bb-dae5f22a116c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:20.442816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09045c84-6b2e-4b2b-a13d-a6e34b55989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:20.443498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09045c84-6b2e-4b2b-a13d-a6e34b55989e None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:20.443775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09045c84-6b2e-4b2b-a13d-a6e34b55989e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:20.444052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09045c84-6b2e-4b2b-a13d-a6e34b55989e None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284/users/eb4a7d0f20ce4e15ba3e1acd54cc113d/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:20.446321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09045c84-6b2e-4b2b-a13d-a6e34b55989e None admin] RBAC: Authorizing `identity:create_grant(project_id=d39e588d6aea463c98420ad4b9124284, user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d, role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:20.447774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09045c84-6b2e-4b2b-a13d-a6e34b55989e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:20.533735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 123/234] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:20 2022] PUT /identity/v3/projects/d39e588d6aea463c98420ad4b9124284/users/eb4a7d0f20ce4e15ba3e1acd54cc113d/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:18:20.987925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e36a04-d4a3-4f69-a725-4d8e99d72627 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:20.987925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e36a04-d4a3-4f69-a725-4d8e99d72627 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:20.987925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e36a04-d4a3-4f69-a725-4d8e99d72627 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:20.987925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 112/235] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:20.993965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616910-a738-423b-827a-66ab88653ad3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:20.994361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616910-a738-423b-827a-66ab88653ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:20.994508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616910-a738-423b-827a-66ab88653ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:21.013943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d1616910-a738-423b-827a-66ab88653ad3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:21.015413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d1616910-a738-423b-827a-66ab88653ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:21.098408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 124/236] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:21.481937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c553a8-40ca-416e-8ee7-9a298ca90264 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:21.483208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c553a8-40ca-416e-8ee7-9a298ca90264 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:21.483918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c553a8-40ca-416e-8ee7-9a298ca90264 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:21.485625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 113/237] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:21.491218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31524-d21d-4489-aa8c-dbfa2d786bb2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:21.491767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31524-d21d-4489-aa8c-dbfa2d786bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:21.492258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31524-d21d-4489-aa8c-dbfa2d786bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:21.516530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1ab31524-d21d-4489-aa8c-dbfa2d786bb2 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:21.518047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1ab31524-d21d-4489-aa8c-dbfa2d786bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:21.528695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c553a8-40ca-416e-8ee7-9a298ca90264 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:21.627098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:21.641199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 125/238] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:21.682491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c553a8-40ca-416e-8ee7-9a298ca90264 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:21.735854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:21.736411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:21.736693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:21.736967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:21.752076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:21.757116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:21.757990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:21.758771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 114/239] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:21.765817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab31524-d21d-4489-aa8c-dbfa2d786bb2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:21.898110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab31524-d21d-4489-aa8c-dbfa2d786bb2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:21.948586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:21.949664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:21.950162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:21.950681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:21.952253 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:21.952839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:21.954557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:21.970293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 126/240] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:21.976628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:22.058663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:22.059144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.125435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.130770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0915e7-0ad3-418c-9a21-a24f02b9fbf3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:22.174833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841669-a47f-4032-b321-0053126f1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:22.175854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841669-a47f-4032-b321-0053126f1d17 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.176205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841669-a47f-4032-b321-0053126f1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.176544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841669-a47f-4032-b321-0053126f1d17 None admin] PATH_INFO: `/v3/users/0eb5aa82b71f445490d8a251b77b1b7f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.181887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57da3-d4b7-4c03-81bd-40f1a11741d1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:22.199376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841669-a47f-4032-b321-0053126f1d17 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb5aa82b71f445490d8a251b77b1b7f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:22.201632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841669-a47f-4032-b321-0053126f1d17 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:22.203651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 115/241] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:21 2022] GET /identity/v3/users/0eb5aa82b71f445490d8a251b77b1b7f => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:22.208073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9041b-6eb5-4ab5-8346-1a780a3e15e9 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.208073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9041b-6eb5-4ab5-8346-1a780a3e15e9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.208073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9041b-6eb5-4ab5-8346-1a780a3e15e9 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.208073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 116/242] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:22.209196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9041b-6eb5-4ab5-8346-1a780a3e15e9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:22.230973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771844c-1b98-480e-8efd-769fb64c2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:22.231920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771844c-1b98-480e-8efd-769fb64c2c1d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.232498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771844c-1b98-480e-8efd-769fb64c2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.233643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771844c-1b98-480e-8efd-769fb64c2c1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.235323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771844c-1b98-480e-8efd-769fb64c2c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:22.236917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771844c-1b98-480e-8efd-769fb64c2c1d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:22.239738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 127/243] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:22.241188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6991d4-dfbc-4353-b3df-6ac7bba93c23 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.241630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6991d4-dfbc-4353-b3df-6ac7bba93c23 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.242042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6991d4-dfbc-4353-b3df-6ac7bba93c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.262320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0c6991d4-dfbc-4353-b3df-6ac7bba93c23 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:22.263591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c6991d4-dfbc-4353-b3df-6ac7bba93c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:22.335195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.337093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 128/244] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:22.345238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6991d4-dfbc-4353-b3df-6ac7bba93c23 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:22.345390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9041b-6eb5-4ab5-8346-1a780a3e15e9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:22.409580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bfe91-c002-4958-ae17-c6e8bd901cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:22.410400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bfe91-c002-4958-ae17-c6e8bd901cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.410673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bfe91-c002-4958-ae17-c6e8bd901cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.410942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bfe91-c002-4958-ae17-c6e8bd901cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.438205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.523602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6991d4-dfbc-4353-b3df-6ac7bba93c23 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:22.541588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bfe91-c002-4958-ae17-c6e8bd901cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:22.543054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bfe91-c002-4958-ae17-c6e8bd901cf7 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:22.586320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:22.586810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.587085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.587353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.587997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:22.590219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:22.678663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 117/245] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:22.679885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 129/246] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:22 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:22.679998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bb0f-b80d-4a19-b749-bac7c2f019f7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.680157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bb0f-b80d-4a19-b749-bac7c2f019f7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.680403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bb0f-b80d-4a19-b749-bac7c2f019f7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.680806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:22.685114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 118/247] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:22.687067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bb0f-b80d-4a19-b749-bac7c2f019f7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:22.687774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.819479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bb0f-b80d-4a19-b749-bac7c2f019f7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:22.834181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bc501-d877-435d-8b54-d5e5d8c0ead7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:22.847887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.869703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef991a4-d913-4ee9-b2cc-85986d2bc8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:22.870344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef991a4-d913-4ee9-b2cc-85986d2bc8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.870678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef991a4-d913-4ee9-b2cc-85986d2bc8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.871010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef991a4-d913-4ee9-b2cc-85986d2bc8f4 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.872204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef991a4-d913-4ee9-b2cc-85986d2bc8f4 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:22.874655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef991a4-d913-4ee9-b2cc-85986d2bc8f4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:22.876484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 119/248] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:22 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:22.877526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c77d0-20c4-488a-bd2c-dbc2a209d9e7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.877810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c77d0-20c4-488a-bd2c-dbc2a209d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.880274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:22.880920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:22.881237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:22.887548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.887651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c77d0-20c4-488a-bd2c-dbc2a209d9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:22.894566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:22.899954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:22.900833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:22.901760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 130/249] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:22.902897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:22.907392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-522c77d0-20c4-488a-bd2c-dbc2a209d9e7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:22.908774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-522c77d0-20c4-488a-bd2c-dbc2a209d9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:23.023326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:23.029793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 120/250] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:23.030332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c77d0-20c4-488a-bd2c-dbc2a209d9e7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:23.091533 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510b23-b65d-4cd4-9db3-7023150f6db1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:23.137155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:23.137809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.138086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.138598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.139802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] RBAC: Adding query filter params (role.id=005a2a7d431545da9ca179397edde797, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=0eb5aa82b71f445490d8a251b77b1b7f) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:23.140121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:23.141609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:23.149642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 131/251] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:22 2022] GET /identity/v3/role_assignments?user.id=0eb5aa82b71f445490d8a251b77b1b7f&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=005a2a7d431545da9ca179397edde797 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:23.160531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c77d0-20c4-488a-bd2c-dbc2a209d9e7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:23.202175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:23.202950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.203226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.203493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.204168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:23.204514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:23.205954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:23.215495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 121/252] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:23.221490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:23.259045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:23.337845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde5154-103a-48ac-b4b8-7bfa2fbb8d7f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:23.364772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:23.385937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:23.386946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.387498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.387980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] PATH_INFO: `/v3/users/c83625dbe91f4e68a34cb295159893be` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.389985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] RBAC: Authorizing `identity:get_user(user_id=c83625dbe91f4e68a34cb295159893be)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:23.391616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:23.393431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 132/253] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:23 2022] GET /identity/v3/users/c83625dbe91f4e68a34cb295159893be => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:23.410736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:23.442092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:23.492813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d3eff-3234-41b6-8a18-75114c0acc08 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:23.539961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e482b9-ccf9-4200-a93c-1e4c7e178a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:23.540966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e482b9-ccf9-4200-a93c-1e4c7e178a3e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.541465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e482b9-ccf9-4200-a93c-1e4c7e178a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.541742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e482b9-ccf9-4200-a93c-1e4c7e178a3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.554020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e482b9-ccf9-4200-a93c-1e4c7e178a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-66e482b9-ccf9-4200-a93c-1e4c7e178a3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:23.559654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:23.560508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:23.561413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 122/254] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:23.562080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698b3db-49c2-4bf0-846a-876973c96133 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.562861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698b3db-49c2-4bf0-846a-876973c96133 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.562861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698b3db-49c2-4bf0-846a-876973c96133 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.564435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 123/255] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:23.570595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129242-1195-4235-b95a-b2a2fa3d4ba0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.570875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129242-1195-4235-b95a-b2a2fa3d4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.571150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129242-1195-4235-b95a-b2a2fa3d4ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.591730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5d129242-1195-4235-b95a-b2a2fa3d4ba0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:23.593518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5d129242-1195-4235-b95a-b2a2fa3d4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:23.615156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7c1a0-9616-4662-bebc-0505f1b92b37 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:23.617104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:23.673907 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 124/256] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:23.675214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129242-1195-4235-b95a-b2a2fa3d4ba0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:23.709970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:23.711784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.712913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.713582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.717380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:23.720238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:23.726024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 133/257] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:23 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:23.732114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:23.752210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:23.856425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129242-1195-4235-b95a-b2a2fa3d4ba0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:23.934367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:23.934976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:23.935261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:23.935533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:23.937998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:23.937998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:23.939319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:23.951982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3191-036b-4041-b4d5-1ff2c341a379 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:23.959210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 125/258] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:23.969964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:24.002249 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:24.002923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:24.003201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:24.003470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284/users/c83625dbe91f4e68a34cb295159893be/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:24.005402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39e588d6aea463c98420ad4b9124284, user_id=c83625dbe91f4e68a34cb295159893be, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:24.006950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:24.088299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 134/259] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:23 2022] PUT /identity/v3/projects/d39e588d6aea463c98420ad4b9124284/users/c83625dbe91f4e68a34cb295159893be/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:18:24.089213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:24.127014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca96e-d1c0-464a-8dc6-3426bfacb9fc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:24.151426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:24.169350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:24.232251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:24.234280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:24.234769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:24.235239 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] PATH_INFO: `/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:24.240210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:24.242043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:24.246496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 126/260] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:23 2022] GET /identity/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:24.252869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:24.284403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f829e-1432-4dba-9c22-362d2540a589 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:24.352432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:24.353278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:24.353560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:24.353832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:24.373651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:24.378476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:24.379406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:24.380541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 135/261] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:24.385890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:24.449384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f65cbf-4528-48f6-b514-5362338d9320 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:24.501483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:24.523706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e867-5cba-4ca9-9156-2eceeebf24dc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:24.528002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:24.528630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:24.528909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:24.529205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:24.606152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:24.606760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:24.607038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:24.607310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:24.608529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:24.608831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:24.610297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:24.630470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 136/262] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:24.636411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:24.645272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:24.689992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:24.691457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:24.865455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938eb9c2-37c5-4c3a-8585-4f6825ae2c51 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:24.908182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 127/263] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:24.913817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:24.938400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:24.939396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:24.939837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:24.940267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] PATH_INFO: `/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:24.941731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] RBAC: Authorizing `identity:get_user(user_id=eb4a7d0f20ce4e15ba3e1acd54cc113d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:24.943414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:24.950129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 137/264] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:24 2022] GET /identity/v3/users/eb4a7d0f20ce4e15ba3e1acd54cc113d => generated 283 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:24.955821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:25.005559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:25.059482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:25.080189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2925e-63a4-4580-8493-4cbc9fdd530c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:25.123167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:25.124915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:25.125390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:25.125864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:25.127183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:25.128834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:25.130665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 128/265] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:24 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:25.131269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cb9e2-3053-4a6e-a633-0ad2fe48798e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:25.137876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:25.215950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:25.217397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:25.217871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:25.218348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:25.353468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:25.353942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc86d5-934e-48d1-aaab-92a87cb223ff None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:25.354938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:25.400879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:25.438797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:25.439436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:25.439721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:25.439993 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:25.440731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:25.441070 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:25.442576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:25.465064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 129/266] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:25 2022] GET /identity/v3/role_assignments?user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:25.535081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 138/267] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:25.540551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:25.568635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:25.693814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99f01b-1c28-4378-bc1a-5929b2710bc9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:25.735751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aac08-0081-4a6c-b6b5-a71f38792851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:25.736397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aac08-0081-4a6c-b6b5-a71f38792851 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:25.736677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aac08-0081-4a6c-b6b5-a71f38792851 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:25.736949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aac08-0081-4a6c-b6b5-a71f38792851 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:25.738131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15aac08-0081-4a6c-b6b5-a71f38792851 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:25.739649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15aac08-0081-4a6c-b6b5-a71f38792851 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:25.741686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 130/268] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:25 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:25.747238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:25.903039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396da8b-95cd-44f8-a124-d0f124cbc4d6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:25.930357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:25.945288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6bd2a-8f64-4fe1-9fd1-4e3e727770e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:25.945828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bd2a-8f64-4fe1-9fd1-4e3e727770e2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:25.946108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bd2a-8f64-4fe1-9fd1-4e3e727770e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:25.946380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bd2a-8f64-4fe1-9fd1-4e3e727770e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:25.947117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bd2a-8f64-4fe1-9fd1-4e3e727770e2 None admin] RBAC: Adding query filter params (role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:25.947420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bd2a-8f64-4fe1-9fd1-4e3e727770e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:25.948937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bd2a-8f64-4fe1-9fd1-4e3e727770e2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:25.958770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 139/269] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:25 2022] GET /identity/v3/role_assignments?user.id=eb4a7d0f20ce4e15ba3e1acd54cc113d&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:26.161683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df954a9-9f17-4098-bacc-c0fccea0d1a0 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.162061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df954a9-9f17-4098-bacc-c0fccea0d1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.162236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df954a9-9f17-4098-bacc-c0fccea0d1a0 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.163653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 131/270] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:26.169439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e015-259a-4bcb-8a70-735c73f6c791 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.169716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e015-259a-4bcb-8a70-735c73f6c791 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.170050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e015-259a-4bcb-8a70-735c73f6c791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.196728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b537e015-259a-4bcb-8a70-735c73f6c791 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:26.197894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b537e015-259a-4bcb-8a70-735c73f6c791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:26.232383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41115-5f8a-48e6-9cc5-06091028a10f None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.233514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41115-5f8a-48e6-9cc5-06091028a10f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.233876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41115-5f8a-48e6-9cc5-06091028a10f None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.235337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 132/271] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:26.241441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b18f9d-7900-40b0-9a86-bcc57f03bf54 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.241742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b18f9d-7900-40b0-9a86-bcc57f03bf54 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.241999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b18f9d-7900-40b0-9a86-bcc57f03bf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.274864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-07b18f9d-7900-40b0-9a86-bcc57f03bf54 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:26.276223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-07b18f9d-7900-40b0-9a86-bcc57f03bf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:26.284118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 140/272] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:26.355953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 133/273] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:26.379209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372841b-0d66-4198-8325-30320efe3ff6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.379506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372841b-0d66-4198-8325-30320efe3ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.379796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372841b-0d66-4198-8325-30320efe3ff6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.381165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 141/274] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:26.386485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598e19c-2ef0-44c2-b239-6f915ffc79eb None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.386771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598e19c-2ef0-44c2-b239-6f915ffc79eb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.387043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598e19c-2ef0-44c2-b239-6f915ffc79eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.407905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a598e19c-2ef0-44c2-b239-6f915ffc79eb None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:26.409087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a598e19c-2ef0-44c2-b239-6f915ffc79eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:26.412072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:26.486598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 134/275] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:26.593130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372841b-0d66-4198-8325-30320efe3ff6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:26.689896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598e19c-2ef0-44c2-b239-6f915ffc79eb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:26.709511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372841b-0d66-4198-8325-30320efe3ff6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:26.725407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:26.752302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:26.752854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.753158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.753486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.754709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:26.756218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:26.758172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 142/276] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:26.763384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:26.813166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598e19c-2ef0-44c2-b239-6f915ffc79eb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:26.851514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:26.852156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.852431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.852700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.863221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:26.864299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:26.869182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:26.876370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 135/277] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:26.877267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:26.890244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd9bb2-e45c-4e9a-aed7-eafd4f58f656 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:26.927394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:26.928012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:26.928299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:26.929064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:26.929817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:26.931333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:26.979890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b569d2-3811-45c9-86db-c5fb2d243282 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.018559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.019143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.019584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.020018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.031709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:27.036491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:27.037514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 136/278] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:27.041867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.061062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 143/279] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:26 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:27.061062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.109837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:27.124762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:27.173862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97003b55-f9e5-4e7b-8140-bd1fd7fff56a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.175487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200bc93-725c-45ca-a725-e8fc0de0224a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.212959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac092648-afda-401e-8918-cdf647b51ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.213208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7e131-df20-4934-ae45-a443770387ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.213794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7e131-df20-4934-ae45-a443770387ec None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.214071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7e131-df20-4934-ae45-a443770387ec None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.214342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7e131-df20-4934-ae45-a443770387ec None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.214732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092648-afda-401e-8918-cdf647b51ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.215022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7e131-df20-4934-ae45-a443770387ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:27.215325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7e131-df20-4934-ae45-a443770387ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:27.215643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092648-afda-401e-8918-cdf647b51ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.216110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac092648-afda-401e-8918-cdf647b51ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.216815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7e131-df20-4934-ae45-a443770387ec None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:27.217256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092648-afda-401e-8918-cdf647b51ac4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:27.217762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092648-afda-401e-8918-cdf647b51ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:27.219417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac092648-afda-401e-8918-cdf647b51ac4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:27.226592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 144/280] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:27.228156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91209ea-f757-4882-928a-fdb99ad45412 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.228581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91209ea-f757-4882-928a-fdb99ad45412 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.228994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91209ea-f757-4882-928a-fdb99ad45412 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.230693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 145/281] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:27.232776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91209ea-f757-4882-928a-fdb99ad45412 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.241057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 137/282] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:27.241057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292cda-43bb-4632-b705-7085b9a4768e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.241057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292cda-43bb-4632-b705-7085b9a4768e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.241057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292cda-43bb-4632-b705-7085b9a4768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.261454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8f292cda-43bb-4632-b705-7085b9a4768e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:27.262723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8f292cda-43bb-4632-b705-7085b9a4768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:27.345111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 138/283] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:27.345915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292cda-43bb-4632-b705-7085b9a4768e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.378388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:27.384853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91209ea-f757-4882-928a-fdb99ad45412 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.410543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:27.428264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.428901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.429241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.429512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] PATH_INFO: `/v3/users/3e0527d8320a4f1aba808c677b140f58` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.446554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0527d8320a4f1aba808c677b140f58)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:27.448369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:27.450593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 146/284] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/users/3e0527d8320a4f1aba808c677b140f58 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:27.457456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.469252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292cda-43bb-4632-b705-7085b9a4768e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.516061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.516793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.517532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.517880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] PATH_INFO: `/v3/users/0eb5aa82b71f445490d8a251b77b1b7f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.519111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb5aa82b71f445490d8a251b77b1b7f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:27.520706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:27.523378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 139/285] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/users/0eb5aa82b71f445490d8a251b77b1b7f => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:27.528783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.583382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b15c8a-304b-46ab-81fa-8d10b81eda68 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.659262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53cb84-576e-4644-aae6-17a8f320f1c9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.669732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.671261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.671770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.672240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.673220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, user.id=3e0527d8320a4f1aba808c677b140f58, scope.system=all) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:27.673733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:27.675373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:27.681358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:27.689505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 147/286] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/role_assignments?user.id=3e0527d8320a4f1aba808c677b140f58&scope.system=all&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:27.698097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.699635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.699635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.699635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.701783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:27.703806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:27.705835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 140/287] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:27.712820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.724247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:27.752111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:27.844001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7050e-410e-443a-b806-5b54a1882e3a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.889866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88877a-b724-4d4c-a8c6-8d40e637a9d4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:27.914274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.915263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.919359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.919676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284/users/0eb5aa82b71f445490d8a251b77b1b7f/roles/005a2a7d431545da9ca179397edde797` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.923041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] RBAC: Authorizing `identity:create_grant(project_id=d39e588d6aea463c98420ad4b9124284, user_id=0eb5aa82b71f445490d8a251b77b1b7f, role_id=005a2a7d431545da9ca179397edde797)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:27.924468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:27.938932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:27.942067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:27.942067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:27.942067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:27.952425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:27.957798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:27.958672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:27.959806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 141/288] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:27.966121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:28.001224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 148/289] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:18:27 2022] PUT /identity/v3/projects/d39e588d6aea463c98420ad4b9124284/users/0eb5aa82b71f445490d8a251b77b1b7f/roles/005a2a7d431545da9ca179397edde797 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:28.035455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:28.103792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8f433-fe1d-4b6e-86a6-7053e02f3aef None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:28.154225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:28.154859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:28.155187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:28.155427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:28.156149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:28.156458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:28.157934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:28.172348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 142/290] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:28.178239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:28.333928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:28.353872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f428c7c-610e-41e5-a431-bd880167ee3f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:28.393454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:28.394214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:28.394394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:28.394657 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] PATH_INFO: `/v3/users/c83625dbe91f4e68a34cb295159893be` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:28.395807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] RBAC: Authorizing `identity:get_user(user_id=c83625dbe91f4e68a34cb295159893be)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:28.397338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:28.399215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 149/291] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:28 2022] GET /identity/v3/users/c83625dbe91f4e68a34cb295159893be => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:28.405094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:28.519163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8516-4cbc-4b7e-9026-3b6b4eaf9969 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:28.530255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:28.559979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:28.561186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:28.561714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:28.562049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:28.656842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:28.658760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:28.776611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 143/292] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:28.782879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:28.910254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a313704-48ec-4e5e-b628-e90122dfa520 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:28.946085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a4c0d-8ccc-48bd-ac76-790efb27fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:28.946719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a4c0d-8ccc-48bd-ac76-790efb27fc21 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:28.946998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a4c0d-8ccc-48bd-ac76-790efb27fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:28.947275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a4c0d-8ccc-48bd-ac76-790efb27fc21 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:28.948564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a4c0d-8ccc-48bd-ac76-790efb27fc21 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:28.950028 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a4c0d-8ccc-48bd-ac76-790efb27fc21 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:28.952850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 150/293] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:28 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:28.959006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:28.975555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:29.093115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea59c-5d91-4e2a-82fb-824dc7d679b0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:29.141163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d649a-48d1-48fa-8143-ac09e7317602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:29.142075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d649a-48d1-48fa-8143-ac09e7317602 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:29.142545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d649a-48d1-48fa-8143-ac09e7317602 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:29.143006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d649a-48d1-48fa-8143-ac09e7317602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:29.143943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d649a-48d1-48fa-8143-ac09e7317602 None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=c83625dbe91f4e68a34cb295159893be) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:29.144498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d649a-48d1-48fa-8143-ac09e7317602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:29.146165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d649a-48d1-48fa-8143-ac09e7317602 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:29.157571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 144/294] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:28 2022] GET /identity/v3/role_assignments?user.id=c83625dbe91f4e68a34cb295159893be&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:29.579932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3676c-892e-4c4e-a4db-7e744233697e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:29.580463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3676c-892e-4c4e-a4db-7e744233697e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:29.580463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3676c-892e-4c4e-a4db-7e744233697e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:29.581985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 151/295] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:29.587673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f9cf-365e-488a-b2e0-05678ca6e762 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:29.588484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f9cf-365e-488a-b2e0-05678ca6e762 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:29.588960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f9cf-365e-488a-b2e0-05678ca6e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:29.609570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8628f9cf-365e-488a-b2e0-05678ca6e762 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:29.611082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8628f9cf-365e-488a-b2e0-05678ca6e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:29.688214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 145/296] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:29.977179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3676c-892e-4c4e-a4db-7e744233697e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:29.998417 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:30.005429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ad711-a3bd-4bb2-9883-b822f0f2993b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.005714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ad711-a3bd-4bb2-9883-b822f0f2993b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.005990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ad711-a3bd-4bb2-9883-b822f0f2993b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.007677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 146/297] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:30.014524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a6125-2f65-44b1-8f5c-cc74e3e94a88 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.014806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a6125-2f65-44b1-8f5c-cc74e3e94a88 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.015086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a6125-2f65-44b1-8f5c-cc74e3e94a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.024432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:30.036588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1f8a6125-2f65-44b1-8f5c-cc74e3e94a88 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:30.037910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1f8a6125-2f65-44b1-8f5c-cc74e3e94a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:30.108494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3676c-892e-4c4e-a4db-7e744233697e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:30.120339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 147/298] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:30.149024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d0972-c837-47f0-aeec-abc694621a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:30.149690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d0972-c837-47f0-aeec-abc694621a2e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.149972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d0972-c837-47f0-aeec-abc694621a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.150242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d0972-c837-47f0-aeec-abc694621a2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.161466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d0972-c837-47f0-aeec-abc694621a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-aa1d0972-c837-47f0-aeec-abc694621a2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:30.166467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:30.167340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:30.168492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 152/299] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:30.174161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a6125-2f65-44b1-8f5c-cc74e3e94a88 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:30.283500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a6125-2f65-44b1-8f5c-cc74e3e94a88 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:30.322981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:30.323644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.323927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.324196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.324863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:30.325192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:30.326602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:30.327981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:30.331153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a346-a2db-404d-8f31-56eeddb59d00 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.331460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a346-a2db-404d-8f31-56eeddb59d00 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.331739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28a346-a2db-404d-8f31-56eeddb59d00 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.333381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 153/300] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:30.335575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 148/301] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:30.340440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684cca-6332-4c5f-af4e-5a2a3ea4c2e1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.340728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684cca-6332-4c5f-af4e-5a2a3ea4c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.341000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684cca-6332-4c5f-af4e-5a2a3ea4c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.342148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:30.361972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0c684cca-6332-4c5f-af4e-5a2a3ea4c2e1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:30.363777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c684cca-6332-4c5f-af4e-5a2a3ea4c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:30.439483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 154/302] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:30.443959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c684cca-6332-4c5f-af4e-5a2a3ea4c2e1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:30.455918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:30.470148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46f88-0986-4ed5-b589-2bb532ffcac9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:30.509403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:30.510068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.510634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.510911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] PATH_INFO: `/v3/users/49dff5df0c464273a4db6d175dcd465d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.527421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] RBAC: Authorizing `identity:get_user(user_id=49dff5df0c464273a4db6d175dcd465d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:30.529638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:30.536617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 149/303] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:30 2022] GET /identity/v3/users/49dff5df0c464273a4db6d175dcd465d => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:30.538073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:30.563036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c684cca-6332-4c5f-af4e-5a2a3ea4c2e1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:30.609249 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:30.610624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:30.612168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.612657 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.613268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.614631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:30.616402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:30.618324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 155/304] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:30.625971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:30.655883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79914a4d-a4ec-4915-92ba-057679c87f37 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:30.691159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:30.691696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.691971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.692241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.692964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] RBAC: Adding query filter params (role.id=005a2a7d431545da9ca179397edde797, user.id=49dff5df0c464273a4db6d175dcd465d, scope.system=all) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:30.693300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:30.694727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:30.709075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 150/305] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Sep 9 21:18:30 2022] GET /identity/v3/role_assignments?user.id=49dff5df0c464273a4db6d175dcd465d&scope.system=all&role.id=005a2a7d431545da9ca179397edde797 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:30.712613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:30.725275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:30.753772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d842f-1e63-4e50-abf1-8de6c7022ad7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:30.801775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:30.802433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.802709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.802977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] PATH_INFO: `/v3/groups` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.803625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:30.805125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:30.834644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c476db0-e373-411d-a32a-1ac1ed92982c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:30.859382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:30.879107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9ddf-65a4-44dd-9a16-a8d13ea67d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:30.879779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9ddf-65a4-44dd-9a16-a8d13ea67d9a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:30.880056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9ddf-65a4-44dd-9a16-a8d13ea67d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:30.880321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9ddf-65a4-44dd-9a16-a8d13ea67d9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:30.891113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 156/306] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Sep 9 21:18:30 2022] POST /identity/v3/groups => generated 229 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:30.893599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9ddf-65a4-44dd-9a16-a8d13ea67d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3c5b9ddf-65a4-44dd-9a16-a8d13ea67d9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:30.898904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:30.899906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:30.905837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 151/307] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:30.907341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:31.003343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dec24-0a90-44ee-a8d6-820d0c8e9c80 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:31.003626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dec24-0a90-44ee-a8d6-820d0c8e9c80 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:31.003898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dec24-0a90-44ee-a8d6-820d0c8e9c80 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:31.005469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 152/308] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:18:31.011036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498fde-6607-4424-a09b-083dafdbb424 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:31.011398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498fde-6607-4424-a09b-083dafdbb424 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:31.011741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498fde-6607-4424-a09b-083dafdbb424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:31.075424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-68498fde-6607-4424-a09b-083dafdbb424 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:31.077774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-68498fde-6607-4424-a09b-083dafdbb424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:31.103894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06349d-1282-4da0-82dc-2a23b73f49b0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:31.145945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:31.146663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:31.147022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:31.147362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:31.148095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:31.148463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:31.149949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:31.153314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:31.162459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 157/309] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:31.168386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:31.168528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 153/310] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:31.274054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc0a0-b58b-4517-bb2d-2242ed48f7ad None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:31.309409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:31.310046 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:31.310864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:31.315676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] PATH_INFO: `/v3/users/3e0527d8320a4f1aba808c677b140f58` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:31.315676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] RBAC: Authorizing `identity:get_user(user_id=3e0527d8320a4f1aba808c677b140f58)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:31.315676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:31.315676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 158/311] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:31 2022] GET /identity/v3/users/3e0527d8320a4f1aba808c677b140f58 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:31.323480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498fde-6607-4424-a09b-083dafdbb424 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:31.463720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498fde-6607-4424-a09b-083dafdbb424 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:31.485575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:31.485928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:31.500387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:31.502759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:31.502759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:31.502759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] PATH_INFO: `/v3/system/users/3e0527d8320a4f1aba808c677b140f58/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:31.503508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e0527d8320a4f1aba808c677b140f58, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:31.505008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:31.582394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:31.601752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 154/312] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Sep 9 21:18:31 2022] PUT /identity/v3/system/users/3e0527d8320a4f1aba808c677b140f58/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:31.626110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f74a8-dbd9-44f1-8bd2-06ede580f51f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:31.674879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:31.675538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:31.676542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:31.676542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:31.697810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:31.708700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:31.709759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:31.710528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:31.716597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 159/313] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:31.722315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:31.908511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677763-bf68-4c78-93e2-ebf2fb84cdd1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:31.947464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:31.948120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:31.948395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:31.948663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:31.949361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:31.949658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:31.951220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:31.960497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 155/314] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:31.966066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:32.075845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61ca8-bc72-4b89-983d-2477a692e3a0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:32.105569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:32.112042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:32.112724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:32.112945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:32.113250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] PATH_INFO: `/v3/users/0eb5aa82b71f445490d8a251b77b1b7f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:32.114421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] RBAC: Authorizing `identity:get_user(user_id=0eb5aa82b71f445490d8a251b77b1b7f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:32.115869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:32.117587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 160/315] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:31 2022] GET /identity/v3/users/0eb5aa82b71f445490d8a251b77b1b7f => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:32.123834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:32.161561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:32.229614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2493f-030d-4caf-a4af-ff16241bb23b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:32.265153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:32.265764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:32.266042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:32.266307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:32.335578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:32.337124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:32.382582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:32.440354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 156/316] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:32.445910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:32.547372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c0e5-8789-4ad8-8836-1dc9b63e95da None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:32.581868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af784d6-199d-469d-b22b-a228cfebf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:32.582495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af784d6-199d-469d-b22b-a228cfebf678 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:32.582771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af784d6-199d-469d-b22b-a228cfebf678 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:32.583045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af784d6-199d-469d-b22b-a228cfebf678 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:32.584362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af784d6-199d-469d-b22b-a228cfebf678 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:32.585876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af784d6-199d-469d-b22b-a228cfebf678 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:32.587597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 161/317] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:32 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:32.595509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:32.698514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da704160-e712-4563-a08b-9d0a4700dd6c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:32.734155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef865e-5ad0-4850-a03e-f34070e99851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:32.734774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef865e-5ad0-4850-a03e-f34070e99851 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:32.735029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef865e-5ad0-4850-a03e-f34070e99851 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:32.735284 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef865e-5ad0-4850-a03e-f34070e99851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:32.736001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef865e-5ad0-4850-a03e-f34070e99851 None admin] RBAC: Adding query filter params (role.id=005a2a7d431545da9ca179397edde797, scope.project.id=d39e588d6aea463c98420ad4b9124284, user.id=0eb5aa82b71f445490d8a251b77b1b7f) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:32.736305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef865e-5ad0-4850-a03e-f34070e99851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:32.737766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef865e-5ad0-4850-a03e-f34070e99851 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:32.743840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 157/318] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:18:32 2022] GET /identity/v3/role_assignments?user.id=0eb5aa82b71f445490d8a251b77b1b7f&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=005a2a7d431545da9ca179397edde797 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:32.744356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:33.022718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf606-cec3-4dc4-a139-5c6085560d00 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.023263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf606-cec3-4dc4-a139-5c6085560d00 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.023263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf606-cec3-4dc4-a139-5c6085560d00 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.024746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 162/319] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:33.030582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31aa24-f8b2-482d-b281-323a059b907b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.030841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31aa24-f8b2-482d-b281-323a059b907b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.031118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31aa24-f8b2-482d-b281-323a059b907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.049655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ad31aa24-f8b2-482d-b281-323a059b907b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:33.050822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ad31aa24-f8b2-482d-b281-323a059b907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:33.119127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 158/320] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:33.275893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69446-223d-4ddf-9754-eaa69583dc81 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.276096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69446-223d-4ddf-9754-eaa69583dc81 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.276539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69446-223d-4ddf-9754-eaa69583dc81 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.278059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 163/321] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:33.283452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424306-f9d6-41e1-a7e7-d334c657ad45 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.283744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424306-f9d6-41e1-a7e7-d334c657ad45 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.284021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424306-f9d6-41e1-a7e7-d334c657ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.302373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-35424306-f9d6-41e1-a7e7-d334c657ad45 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:33.303535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-35424306-f9d6-41e1-a7e7-d334c657ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:33.370084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 159/322] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:33.396256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd69446-223d-4ddf-9754-eaa69583dc81 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:33.461751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:33.502752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd69446-223d-4ddf-9754-eaa69583dc81 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:33.537594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:33.538150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.538430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.538703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.548699 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:33.553983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:33.554917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:33.557974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 164/323] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:33.561183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424306-f9d6-41e1-a7e7-d334c657ad45 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:33.620889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:33.641381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:33.665931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424306-f9d6-41e1-a7e7-d334c657ad45 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:33.702698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:33.703323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.703607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.703880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.704571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:33.704853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:33.706259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:33.714811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 160/324] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:33.722385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:33.753415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ed9d-2e72-4079-aa2b-1a5f3d2db286 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:33.779649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:33.799080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:33.799080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.799080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.799080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.799618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:33.799618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:33.799618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 165/325] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:33.804664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:33.831683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922612d-5bc2-45f0-aa9e-d57b634fa584 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:33.854392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:33.868375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:33.869010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.869321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.869645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] PATH_INFO: `/v3/users/49dff5df0c464273a4db6d175dcd465d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.870714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] RBAC: Authorizing `identity:get_user(user_id=49dff5df0c464273a4db6d175dcd465d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:33.872147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:33.874581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 161/326] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:33 2022] GET /identity/v3/users/49dff5df0c464273a4db6d175dcd465d => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:33.880168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:33.916592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4567b2b-1a00-450b-8788-8bf84e4f7f76 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:33.952297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f3aba-71fd-4288-825c-2f115ef89d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:33.952897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3aba-71fd-4288-825c-2f115ef89d1e None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:33.953213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3aba-71fd-4288-825c-2f115ef89d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:33.953539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3aba-71fd-4288-825c-2f115ef89d1e None admin] PATH_INFO: `/v3/groups` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:33.954317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f3aba-71fd-4288-825c-2f115ef89d1e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:33.956180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f3aba-71fd-4288-825c-2f115ef89d1e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:33.979049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32600673-4d18-4cc6-a259-354fb3d76218 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:34.012555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:34.013344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:34.013719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:34.013992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] PATH_INFO: `/v3/system/users/49dff5df0c464273a4db6d175dcd465d/roles/005a2a7d431545da9ca179397edde797` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:34.015383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=49dff5df0c464273a4db6d175dcd465d, role_id=005a2a7d431545da9ca179397edde797)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:34.016830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:34.054521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 166/327] 10.222.0.60 () {60 vars in 1134 bytes} [Fri Sep 9 21:18:33 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:18:34.055672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de725-ff36-45bc-9ec7-8dba62ddc7c3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:34.055957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de725-ff36-45bc-9ec7-8dba62ddc7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:34.056231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45de725-ff36-45bc-9ec7-8dba62ddc7c3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:34.057550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 167/328] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:34.064016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd177-3ef9-4919-8f88-2967b19226b2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:34.064301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd177-3ef9-4919-8f88-2967b19226b2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:34.064576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd177-3ef9-4919-8f88-2967b19226b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:34.084097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ce2cd177-3ef9-4919-8f88-2967b19226b2 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:34.085373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce2cd177-3ef9-4919-8f88-2967b19226b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:34.103545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 162/329] 10.222.0.60 () {58 vars in 1334 bytes} [Fri Sep 9 21:18:33 2022] PUT /identity/v3/system/users/49dff5df0c464273a4db6d175dcd465d/roles/005a2a7d431545da9ca179397edde797 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:18:34.141290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:34.164641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 168/330] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:34.437299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:34.493467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:34.548213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1941a-b911-43be-b379-afc2f156d978 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:34.589460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:34.590484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:34.590965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:34.592282 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:34.603918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:34.610227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:34.611196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:34.612217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:34.614597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 163/331] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:34.620438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cd177-3ef9-4919-8f88-2967b19226b2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:34.724125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cd177-3ef9-4919-8f88-2967b19226b2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:34.759625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:34.760235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:34.760510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:34.760777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:34.761475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:34.761775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:34.763727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:34.774818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 169/332] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:34.781324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:34.899260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae286-c7d4-4cd9-b9a3-9f21860d196e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:34.913902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:34.936770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ffbe3-1a78-4386-a597-e6e556fb9e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:34.937468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ffbe3-1a78-4386-a597-e6e556fb9e42 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:34.937799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ffbe3-1a78-4386-a597-e6e556fb9e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:34.938077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ffbe3-1a78-4386-a597-e6e556fb9e42 None admin] PATH_INFO: `/v3/users/3e0527d8320a4f1aba808c677b140f58` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:34.939279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ffbe3-1a78-4386-a597-e6e556fb9e42 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0527d8320a4f1aba808c677b140f58)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:34.940826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ffbe3-1a78-4386-a597-e6e556fb9e42 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:34.942887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 164/333] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:34 2022] GET /identity/v3/users/3e0527d8320a4f1aba808c677b140f58 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:34.950641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:34.998870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:35.070320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2163bd9-697d-4bfc-b605-5485b59f6f3a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:35.111680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0cf57-5d6e-48b5-8108-69d3fd766764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:35.112298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0cf57-5d6e-48b5-8108-69d3fd766764 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:35.112575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0cf57-5d6e-48b5-8108-69d3fd766764 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:35.112848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0cf57-5d6e-48b5-8108-69d3fd766764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:35.113678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0cf57-5d6e-48b5-8108-69d3fd766764 None admin] RBAC: Adding query filter params (role.id=964027a7b5cf4ac5b2efd48eaa98c589, user.id=3e0527d8320a4f1aba808c677b140f58, scope.system=all) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:35.113984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0cf57-5d6e-48b5-8108-69d3fd766764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:35.115410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0cf57-5d6e-48b5-8108-69d3fd766764 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:35.134340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 170/334] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Sep 9 21:18:34 2022] GET /identity/v3/role_assignments?user.id=3e0527d8320a4f1aba808c677b140f58&scope.system=all&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:37.126809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57927-f90d-4410-b394-419b068512f9 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.127296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57927-f90d-4410-b394-419b068512f9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.127635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57927-f90d-4410-b394-419b068512f9 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.130693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 165/335] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:37.137312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937af80-9494-4a90-9f21-55edd6cba9e3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.138098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937af80-9494-4a90-9f21-55edd6cba9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.138098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937af80-9494-4a90-9f21-55edd6cba9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.162686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7937af80-9494-4a90-9f21-55edd6cba9e3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:37.163923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7937af80-9494-4a90-9f21-55edd6cba9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:37.249683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 171/336] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:37.258906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed97b-30bb-4fcf-b888-1ea0a45af37f None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.259191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed97b-30bb-4fcf-b888-1ea0a45af37f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.259480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed97b-30bb-4fcf-b888-1ea0a45af37f None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.261048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 166/337] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:37.279630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a21878-3ab4-409e-86c8-0d31be0826c8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.279945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a21878-3ab4-409e-86c8-0d31be0826c8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.280179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a21878-3ab4-409e-86c8-0d31be0826c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.281644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d5e24-7558-4051-aed8-ef6c9ab17830 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.282151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d5e24-7558-4051-aed8-ef6c9ab17830 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.282620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d5e24-7558-4051-aed8-ef6c9ab17830 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.284405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 167/338] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:37.289423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e64fd-6154-4c25-8b19-21f8d7404513 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.289954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e64fd-6154-4c25-8b19-21f8d7404513 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.290485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e64fd-6154-4c25-8b19-21f8d7404513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.301044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e1a21878-3ab4-409e-86c8-0d31be0826c8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:37.302243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e1a21878-3ab4-409e-86c8-0d31be0826c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:37.321193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-825e64fd-6154-4c25-8b19-21f8d7404513 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:37.322893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-825e64fd-6154-4c25-8b19-21f8d7404513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:37.327827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:37.387635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 172/339] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:37.389484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4203-c774-41dd-9d1c-bd96c57f01cb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.389770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4203-c774-41dd-9d1c-bd96c57f01cb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.390041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4203-c774-41dd-9d1c-bd96c57f01cb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.391281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 173/340] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:37.396611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc8bd-acdb-4017-8690-677e853526c8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.396888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc8bd-acdb-4017-8690-677e853526c8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.397187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc8bd-acdb-4017-8690-677e853526c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.401452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 168/341] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:37.424515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d29fc8bd-acdb-4017-8690-677e853526c8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:37.425724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d29fc8bd-acdb-4017-8690-677e853526c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:37.511086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 174/342] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:37.714344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e64fd-6154-4c25-8b19-21f8d7404513 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:37.747820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc8bd-acdb-4017-8690-677e853526c8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:37.896220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:37.908666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e64fd-6154-4c25-8b19-21f8d7404513 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:37.909560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc8bd-acdb-4017-8690-677e853526c8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:37.922050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:37.952651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:37.953597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.953868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.954152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.960125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:37.961010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:37.961800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:37.962357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:37.968042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:37.974115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:37.975345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:37.976292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:37.977869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:37.983356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 169/343] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:37.983466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:37.984291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:37.985117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 175/344] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:37.985794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:37.987121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:38.176074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b876e-8cd1-4c5c-ab9f-16998d2871db None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.180034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50182d9a-5742-44eb-998c-5641aa9b3552 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.219977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.221080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.221333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.221887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.232414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.233186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.233594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.233867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.235696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:38.241522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:38.242445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:38.243315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 176/345] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:38.244078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:38.251062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:38.256532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:38.258669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 170/346] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:38.260596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:38.262312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:38.300977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:38.369079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ac490-ba92-4d7b-8f47-47e1cac7c490 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.378751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb9dc-62d0-4ebe-8799-1472b8d8c113 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.412118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.412756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.413052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.413332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.414043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:38.414555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:38.416762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:38.426567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.426972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 177/347] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:38.427782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.427886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:38.428371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.428836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.429733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:38.430232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:38.431867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:38.445891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 171/348] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:38.447018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:38.520786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:38.556253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:38.557465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44738f30-f57c-4d5b-8a3c-7ae60304a23a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.567534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9606c6-5915-49a5-9a06-f923b3742823 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.601891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.602865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.603301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.603577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.604240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:38.604544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:38.605968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:38.606289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.607503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.607740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.608013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.608669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:38.608972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:38.610368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:38.618736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 172/350] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:38.619659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:38.621131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 178/349] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:38.623160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:38.751245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7578844-f432-46df-8ad9-aabf2caa1ed0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.762254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fb15d-d0b7-447d-a063-630186c60565 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:38.788531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b28c4-3337-4d8a-87b8-d16b101534a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.789107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b28c4-3337-4d8a-87b8-d16b101534a3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.789657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b28c4-3337-4d8a-87b8-d16b101534a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.789657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b28c4-3337-4d8a-87b8-d16b101534a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.807678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488330-e102-4759-a428-125350d278c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:38.808564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488330-e102-4759-a428-125350d278c1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:38.808845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488330-e102-4759-a428-125350d278c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:38.809316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488330-e102-4759-a428-125350d278c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:38.813294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:38.818883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:38.874058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b28c4-3337-4d8a-87b8-d16b101534a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:38.875553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b28c4-3337-4d8a-87b8-d16b101534a3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:38.902802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af488330-e102-4759-a428-125350d278c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:38.904504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af488330-e102-4759-a428-125350d278c1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.008305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 173/351] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:39.010110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2346a1-e109-4b8e-9ab0-d353d2b3b1c8 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.010397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2346a1-e109-4b8e-9ab0-d353d2b3b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.011080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2346a1-e109-4b8e-9ab0-d353d2b3b1c8 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.016965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 174/352] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:39.017801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2346a1-e109-4b8e-9ab0-d353d2b3b1c8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.040128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 179/353] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:39.041216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488330-e102-4759-a428-125350d278c1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.084151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.096190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.156810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2346a1-e109-4b8e-9ab0-d353d2b3b1c8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.165541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488330-e102-4759-a428-125350d278c1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.204406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.205917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.206262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.206604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.211087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.212247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.212699 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.213184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] PATH_INFO: `/v3/users/49dff5df0c464273a4db6d175dcd465d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.214509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] RBAC: Authorizing `identity:get_user(user_id=49dff5df0c464273a4db6d175dcd465d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.216236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.218278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 180/354] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/users/49dff5df0c464273a4db6d175dcd465d => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:39.219406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.295467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.297142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.352186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22931e3-17ea-47cb-a3f5-67925c223f5d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.353919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.376325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.393939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938e9b6-3709-4caa-92c0-7755aa055e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.394578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e9b6-3709-4caa-92c0-7755aa055e3c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.394854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e9b6-3709-4caa-92c0-7755aa055e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.395126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e9b6-3709-4caa-92c0-7755aa055e3c None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.397208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938e9b6-3709-4caa-92c0-7755aa055e3c None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.398645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938e9b6-3709-4caa-92c0-7755aa055e3c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.400291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 181/355] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:39.401465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902ac76-efe4-4a77-b4d8-420d8b751465 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.401745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902ac76-efe4-4a77-b4d8-420d8b751465 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.402015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902ac76-efe4-4a77-b4d8-420d8b751465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.424520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6902ac76-efe4-4a77-b4d8-420d8b751465 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:39.425726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6902ac76-efe4-4a77-b4d8-420d8b751465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:39.431105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 175/356] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:39.432019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.506731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 182/357] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:39.507850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902ac76-efe4-4a77-b4d8-420d8b751465 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.553555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef92a5-c048-478c-9f47-690f0405bdb7 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.597106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164a4fa-acfc-4344-81fb-eeb2d42ba6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.597308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a4fa-acfc-4344-81fb-eeb2d42ba6bf None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.599020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a4fa-acfc-4344-81fb-eeb2d42ba6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.599020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a4fa-acfc-4344-81fb-eeb2d42ba6bf None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.600871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164a4fa-acfc-4344-81fb-eeb2d42ba6bf None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.602428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164a4fa-acfc-4344-81fb-eeb2d42ba6bf None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.604096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 176/358] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:39.605268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a1308-29f8-4073-b93d-4267b7ffc285 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.605652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a1308-29f8-4073-b93d-4267b7ffc285 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.605932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a1308-29f8-4073-b93d-4267b7ffc285 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.607393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 177/359] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:39.607953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a1308-29f8-4073-b93d-4267b7ffc285 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.634740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.650794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.655303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902ac76-efe4-4a77-b4d8-420d8b751465 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.701014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.702093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.702588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.703601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.706069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] RBAC: Adding query filter params (role.id=005a2a7d431545da9ca179397edde797, user.id=49dff5df0c464273a4db6d175dcd465d, scope.system=all) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:39.707017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.709400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.724436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 183/360] 10.222.0.60 () {56 vars in 1308 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/role_assignments?user.id=49dff5df0c464273a4db6d175dcd465d&scope.system=all&role.id=005a2a7d431545da9ca179397edde797 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:39.726224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.736270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a1308-29f8-4073-b93d-4267b7ffc285 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.777330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.778218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.778656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.779477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.786934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.788849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.790985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 178/361] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:39.792349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:39.873728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03597f2-9460-4f9f-9ad3-d3b684a3b501 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.918369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.926041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a581d99-01c8-46e5-a6b0-978cba690395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.926338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a581d99-01c8-46e5-a6b0-978cba690395 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.927498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a581d99-01c8-46e5-a6b0-978cba690395 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.927498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a581d99-01c8-46e5-a6b0-978cba690395 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.927980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a581d99-01c8-46e5-a6b0-978cba690395 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.929570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a581d99-01c8-46e5-a6b0-978cba690395 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.931241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 184/362] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:39.932365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f616-607e-4ed1-84f8-2d30d791e360 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.932663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f616-607e-4ed1-84f8-2d30d791e360 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.932982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f616-607e-4ed1-84f8-2d30d791e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.940145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a10f-5c95-4e1c-bd0a-4ef412207153 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:39.953560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bff4f616-607e-4ed1-84f8-2d30d791e360 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:39.954975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bff4f616-607e-4ed1-84f8-2d30d791e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:39.982503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:39.986456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:39.987274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:39.987692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:39.988114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:39.989262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:39.990905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:39.994874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 179/363] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:39.994874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.047996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 185/364] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:40.050022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f616-607e-4ed1-84f8-2d30d791e360 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.121247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e586c-a3ee-4884-905f-13a3abf73ea6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.165570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.166415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.166704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.166976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.168086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=ef95371881d74261aacce73d3647ecf0) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:40.168403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:40.171841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:40.178347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 180/365] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:39 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:40.179051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.184582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f616-607e-4ed1-84f8-2d30d791e360 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.208840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:40.234351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.235022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.235291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.235565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.250680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:40.256653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:40.257697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:40.259125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.283473 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:40.334889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba261fb-6fc7-4467-9bbc-e4ec7545cb50 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.379946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.380511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.380792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.381093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.382273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:40.383858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:40.385951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 181/367] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:40.386756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.397574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc135-1397-40c7-9bd4-fefbcbb84e45 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.436134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.436479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.436756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.437040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.437769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=ef95371881d74261aacce73d3647ecf0) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:40.438076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:40.439545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:40.446651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 187/368] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:40.447456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.496030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:40.515269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca75bf-5916-48a5-ab18-4d401d8ad754 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.562686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:40.571548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.576827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.576827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.576827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.576827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:40.576827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:40.577420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:40.589616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 182/369] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:40.589820 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.590166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952376ab-4c35-430a-8890-8c0045630584 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.639417 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.639941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.640318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.642992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.656981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:40.664743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:40.665717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:40.666494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 188/370] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:40.667213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.735505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e19e3-3e4a-4761-94e5-d8d29f5519c9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.788204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.789297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.789631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.789911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.790967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=d39e588d6aea463c98420ad4b9124284) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:40.791557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:40.793201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:40.807455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 183/371] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:40.808683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:40.829329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd47b-77cb-47c1-ba07-f9fa883f5b4f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:40.844360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:40.892362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:40.892901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:40.893211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:40.893554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:40.907055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:40.986381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:40.988210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:41.049324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c93da-f31f-4a32-8352-79a77fee0253 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:41.107762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:41.108536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:41.108821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:41.109117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:41.109784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:41.110138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:41.111529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:41.127658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 184/372] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:41.133500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:41.148852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 189/373] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:41.154834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:41.246125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:41.250911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:41.281672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262ae14-542e-4350-831e-4bfb3893a1a1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:41.362023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:41.362647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:41.362929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:41.363199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:41.378784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df9e1f-d333-4029-a912-d2b9b04259a9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:41.444748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:41.445373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:41.445655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:41.445921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:41.447793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:41.450005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:41.459343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 190/374] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:41 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:41.466031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:41.486922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:41.488388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:41.616434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:41.655176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288d2a-cfa6-4f02-9f80-1915f9b7df2c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:41.662776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 185/375] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:41.668426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:41.677435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:41.716687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:41.717370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:41.717658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:41.717939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:41.719416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:41.720683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:41.727840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 191/376] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:41 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:41.728669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:41.884554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54907b1e-c620-4ab2-b6e2-3b593b0e1a49 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:41.913464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb9f79-1a8a-45fa-b540-5e270386b107 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:41.963171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:41.963824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:41.964106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:41.964380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] PATH_INFO: `/v3/projects/d490483b5cc64ba0b5021ee96204079c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:41.969829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] RBAC: Authorizing `identity:get_project(project_id=d490483b5cc64ba0b5021ee96204079c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:41.972800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:41.975181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 186/377] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:41 2022] GET /identity/v3/projects/d490483b5cc64ba0b5021ee96204079c => generated 344 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:41.980876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:41.981735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:41.982143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:41.982436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:41.983268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=d39e588d6aea463c98420ad4b9124284) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:41.983578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:41.985146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:41.988762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:42.001710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 192/378] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:41 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:42.062581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:42.142483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d80b53-4361-4e99-b135-2eda5365432c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:42.192214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2497b-55d5-4848-bb39-86cbc196a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:42.192911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2497b-55d5-4848-bb39-86cbc196a94c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:42.193215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2497b-55d5-4848-bb39-86cbc196a94c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:42.193483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2497b-55d5-4848-bb39-86cbc196a94c None admin] PATH_INFO: `/v3/groups/7d9bf3c6956d4659aba3f12cca11a24d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:42.202862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2497b-55d5-4848-bb39-86cbc196a94c None admin] RBAC: Authorizing `identity:get_group(group_id=7d9bf3c6956d4659aba3f12cca11a24d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:42.204328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2497b-55d5-4848-bb39-86cbc196a94c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:42.206326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 187/379] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:41 2022] GET /identity/v3/groups/7d9bf3c6956d4659aba3f12cca11a24d => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:42.212536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:42.265550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:42.354213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f885db0-106c-480e-984c-907085c5d893 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:42.399283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58215c-b193-418b-b29a-8963319efff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:42.399960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58215c-b193-418b-b29a-8963319efff6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:42.400238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58215c-b193-418b-b29a-8963319efff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:42.400513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58215c-b193-418b-b29a-8963319efff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:42.401398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58215c-b193-418b-b29a-8963319efff6 None admin] RBAC: Adding query filter params (group.id=7d9bf3c6956d4659aba3f12cca11a24d, role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=d490483b5cc64ba0b5021ee96204079c) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:42.401939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58215c-b193-418b-b29a-8963319efff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:42.404126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58215c-b193-418b-b29a-8963319efff6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:42.410342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 193/380] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:42 2022] GET /identity/v3/role_assignments?group.id=7d9bf3c6956d4659aba3f12cca11a24d&scope.project.id=d490483b5cc64ba0b5021ee96204079c&role.id=eea82d73b0db450f9f23e5256483a93e => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:42.884623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89850d-d692-4377-be6b-641fca30a0bb None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:42.885194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89850d-d692-4377-be6b-641fca30a0bb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:42.885194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89850d-d692-4377-be6b-641fca30a0bb None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:42.886769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 188/381] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:42.899759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170304b-fb00-49bb-89a0-440d52aa9795 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:42.900058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170304b-fb00-49bb-89a0-440d52aa9795 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:42.900317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170304b-fb00-49bb-89a0-440d52aa9795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:42.929431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3170304b-fb00-49bb-89a0-440d52aa9795 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:42.930672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3170304b-fb00-49bb-89a0-440d52aa9795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:43.022618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 194/382] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:43.039865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cb946-071d-4c7b-8346-c126863cb780 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:43.040137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cb946-071d-4c7b-8346-c126863cb780 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:43.040398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cb946-071d-4c7b-8346-c126863cb780 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:43.042040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 189/383] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:43.047521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ef14-3996-4c1e-a3ba-06b714a5074d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:43.047804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ef14-3996-4c1e-a3ba-06b714a5074d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:43.048079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ef14-3996-4c1e-a3ba-06b714a5074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:43.073136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bad4ef14-3996-4c1e-a3ba-06b714a5074d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:43.074307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bad4ef14-3996-4c1e-a3ba-06b714a5074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:43.114753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:43.163573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 195/384] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:43.425216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cb946-071d-4c7b-8346-c126863cb780 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:43.598541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667820ba-70c9-41bb-a1bf-9498e50e2e9f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:43.599038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667820ba-70c9-41bb-a1bf-9498e50e2e9f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:43.599113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667820ba-70c9-41bb-a1bf-9498e50e2e9f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:43.600915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 196/385] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:43.605964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ac2c-3441-4428-85ef-01d0401cfcdf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:43.606241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ac2c-3441-4428-85ef-01d0401cfcdf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:43.606554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ac2c-3441-4428-85ef-01d0401cfcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:43.610451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cb946-071d-4c7b-8346-c126863cb780 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:43.625523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:43.625756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e3e3ac2c-3441-4428-85ef-01d0401cfcdf None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:43.626973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e3e3ac2c-3441-4428-85ef-01d0401cfcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:43.690819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:43.691354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:43.691640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:43.691910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:43.697391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 197/386] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:43.708345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:43.713217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:43.715146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:43.716919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 190/387] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:43.723458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ac2c-3441-4428-85ef-01d0401cfcdf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:43.761658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:43.881587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:43.889320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ac2c-3441-4428-85ef-01d0401cfcdf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:43.918681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b8d8-e085-403e-8a2d-408f157f9916 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:43.958135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:43.958675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:43.958950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:43.959218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:43.971322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:43.973714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:43.974590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:43.974875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:43.975152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:43.975889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:43.976198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:43.976871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:43.978799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:43.980287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:43.981564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:43.981699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 191/388] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:43.990432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.010918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 198/389] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:44.017978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.037996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:44.193076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38853-ef94-482c-a5a4-0f221bfb2a41 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.207831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf93e2-b206-44e0-8b3d-d9f7b478ae8c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.244677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.245331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.245659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.245942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.248085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:44.250243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:44.253293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.254429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.255028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.255598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.256578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 199/390] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:44 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:44.257021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:44.257424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.257803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:44.260567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:44.282796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 192/391] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:44.284313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.288899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:44.376589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58d7ef-ffcc-447a-b52f-ae075eb1502d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.417462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.418193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.418578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.419146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.420731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:44.431912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:44.433920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd51f2-b2b3-4f5c-a919-dd9e5f700117 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:44.438568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:44.439468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:44.440572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 200/392] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:44.445298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.476852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.477826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.478285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.478838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.480213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:44.483138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:44.485411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 193/393] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:44 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:44.486615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.549333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:44.568203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f7e3-2bb9-4830-bf95-80f700bd2123 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.603101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416fb19-3619-4f64-b184-e50096b7f08c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.610283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.610924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.611204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.611474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.612598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:44.614066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:44.620243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 201/394] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:44 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:44.620243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.651075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.651962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.652398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.654499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.655332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:44.655849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:44.657893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:44.667061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 194/395] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:44.668263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.697688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:44.750427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a854b8-b042-4ae7-8eed-4a1e1ad5859b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.788579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.789282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.789560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.789832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.791763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] RBAC: Authorizing `identity:create_grant(project_id=ef95371881d74261aacce73d3647ecf0, group_id=a81ff94c5bce43d2ae3a6c304b86636e, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:44.793947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:44.814393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997244f-68df-4921-b3a4-36e45cfc563e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:44.848634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:44.849810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:44.850088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:44.850356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:44.851497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:44.852925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:44.854826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 195/396] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:44 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:44.855402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.868977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 202/397] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Sep 9 21:18:44 2022] PUT /identity/v3/projects/ef95371881d74261aacce73d3647ecf0/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:44.869775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:44.891581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:45.012124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2348690-03e3-4342-9d09-94ccec483fbd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:45.031965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:45.065772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6bb96-7766-454f-bfa3-dfa1b53d3bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:45.066367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6bb96-7766-454f-bfa3-dfa1b53d3bd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.066655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6bb96-7766-454f-bfa3-dfa1b53d3bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.066964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6bb96-7766-454f-bfa3-dfa1b53d3bd3 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.070637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6bb96-7766-454f-bfa3-dfa1b53d3bd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef95371881d74261aacce73d3647ecf0, group_id=a81ff94c5bce43d2ae3a6c304b86636e, role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:45.072135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6bb96-7766-454f-bfa3-dfa1b53d3bd3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:45.077786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024a157-1937-456d-9b80-eeb9f05ac934 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:45.125110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8b2f4-63b9-44d7-8378-d2257b17041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:45.126104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8b2f4-63b9-44d7-8378-d2257b17041a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.126532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8b2f4-63b9-44d7-8378-d2257b17041a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.126954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8b2f4-63b9-44d7-8378-d2257b17041a None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.128497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8b2f4-63b9-44d7-8378-d2257b17041a None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:45.130385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8b2f4-63b9-44d7-8378-d2257b17041a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:45.132355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 196/398] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:44 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:45.137609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad792de4-70c4-499c-89fd-70b987349f3b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.139038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad792de4-70c4-499c-89fd-70b987349f3b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.139038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad792de4-70c4-499c-89fd-70b987349f3b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.140124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 197/399] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:18:45.140815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad792de4-70c4-499c-89fd-70b987349f3b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:45.167073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 203/400] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Sep 9 21:18:44 2022] PUT /identity/v3/projects/ef95371881d74261aacce73d3647ecf0/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:45.168105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa30e0-1b8f-4821-b1f6-f75045118bcf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.168390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa30e0-1b8f-4821-b1f6-f75045118bcf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.168687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa30e0-1b8f-4821-b1f6-f75045118bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.195009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d3fa30e0-1b8f-4821-b1f6-f75045118bcf None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:45.197779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d3fa30e0-1b8f-4821-b1f6-f75045118bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:45.305578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad792de4-70c4-499c-89fd-70b987349f3b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:45.321477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 204/401] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:45.322698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7eb09-3160-4244-8196-ce38ef58fa00 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.322988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7eb09-3160-4244-8196-ce38ef58fa00 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.323258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7eb09-3160-4244-8196-ce38ef58fa00 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.329220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 205/402] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:45.352499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd5966-703b-4df1-ae60-41f3c935847c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.352801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd5966-703b-4df1-ae60-41f3c935847c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.353176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd5966-703b-4df1-ae60-41f3c935847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.362311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:45.369875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:45.373648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.373929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.375910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.375910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:45.378457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:45.380791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 198/403] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:45 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:45.385990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:45.391807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-06cd5966-703b-4df1-ae60-41f3c935847c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:45.393254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-06cd5966-703b-4df1-ae60-41f3c935847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:45.414323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:45.493749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 206/404] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:45.515867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576889a5-b44f-4a26-b04d-3a3cb782a112 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:45.570776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:45.571825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.572239 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.572645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.574681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] RBAC: Authorizing `identity:create_grant(project_id=d39e588d6aea463c98420ad4b9124284, group_id=a81ff94c5bce43d2ae3a6c304b86636e, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:45.576786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:45.644673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd5966-703b-4df1-ae60-41f3c935847c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:45.701222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 199/405] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Sep 9 21:18:45 2022] PUT /identity/v3/projects/d39e588d6aea463c98420ad4b9124284/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:45.786592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:45.792475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd5966-703b-4df1-ae60-41f3c935847c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:45.843552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:45.853617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:45.861834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:45.861834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:45.861834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:45.881420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:45.894886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:45.895832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:45.896698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:45.897331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 207/406] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:45.902499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:45.946110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:45.973388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a2038-d5b7-48cb-b361-8f8392799a4a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.018158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.019126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.019682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.020227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.023346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5af369-36bb-4bd7-b8d6-aed1a9d41ed8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.033369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:46.039142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:46.040024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:46.040798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:46.043241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 200/407] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:46.054125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:46.086855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.087836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.088292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.088709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.089552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:46.090252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:46.092557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:46.114813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 208/408] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:46.120267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:46.217937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:46.245168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9efe0e-8e40-4600-b60e-67ac517e4c9a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.266571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e637-dc1f-4fa0-bce6-241cd73ab637 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.302084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.302722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.303000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.303271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.304371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:46.305823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:46.307693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 209/409] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:46 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:46.315878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:46.330084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.330701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.330974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.331241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.331901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:46.332198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:46.333586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:46.351738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 201/410] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:46.358329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:46.361944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:46.504666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf653d-781a-4e7b-8feb-0641fdee7295 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.522812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64de91f-0409-423d-b3c9-92d9e6cdbd9e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.545392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:46.564889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.565550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.565826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.566096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.567921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:46.569461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:46.571389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 210/411] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:46 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:46.577106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:46.592175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.592827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.593143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.593420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] PATH_INFO: `/v3/groups/7d9bf3c6956d4659aba3f12cca11a24d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.595557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] RBAC: Authorizing `identity:get_group(group_id=7d9bf3c6956d4659aba3f12cca11a24d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:46.597019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:46.601575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 202/412] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:46 2022] GET /identity/v3/groups/7d9bf3c6956d4659aba3f12cca11a24d => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:46.619104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:46.748765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5f8b5-187d-46c5-9965-dc1eb7c73791 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.755486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:46.791373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e15fd0-2ab1-4edb-a866-902796c516f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.792076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15fd0-2ab1-4edb-a866-902796c516f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.792403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15fd0-2ab1-4edb-a866-902796c516f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.792677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15fd0-2ab1-4edb-a866-902796c516f7 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.797189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e15fd0-2ab1-4edb-a866-902796c516f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39e588d6aea463c98420ad4b9124284, group_id=a81ff94c5bce43d2ae3a6c304b86636e, role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:46.798640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e15fd0-2ab1-4edb-a866-902796c516f7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:46.814284 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479354d-4971-477f-aceb-b7958f8d335f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:46.854586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:46.855412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:46.855787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:46.856574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] PATH_INFO: `/v3/projects/d490483b5cc64ba0b5021ee96204079c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:46.857833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] RBAC: Authorizing `identity:get_project(project_id=d490483b5cc64ba0b5021ee96204079c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:46.859358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:46.861488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 203/413] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:46 2022] GET /identity/v3/projects/d490483b5cc64ba0b5021ee96204079c => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:46.867174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:46.880243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 211/414] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Sep 9 21:18:46 2022] PUT /identity/v3/projects/d39e588d6aea463c98420ad4b9124284/groups/a81ff94c5bce43d2ae3a6c304b86636e/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:46.993003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96865681-d235-4507-816e-64ce0637a7ab None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:47.033253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdb075-422c-464f-9dab-2adba908500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:47.033856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb075-422c-464f-9dab-2adba908500b None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:47.034374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb075-422c-464f-9dab-2adba908500b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:47.034374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb075-422c-464f-9dab-2adba908500b None admin] PATH_INFO: `/v3/projects/d490483b5cc64ba0b5021ee96204079c/groups/7d9bf3c6956d4659aba3f12cca11a24d/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:47.036357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdb075-422c-464f-9dab-2adba908500b None admin] RBAC: Authorizing `identity:create_grant(project_id=d490483b5cc64ba0b5021ee96204079c, group_id=7d9bf3c6956d4659aba3f12cca11a24d, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:47.037849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdb075-422c-464f-9dab-2adba908500b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:47.110923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:47.115795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 204/415] 10.222.0.60 () {58 vars in 1442 bytes} [Fri Sep 9 21:18:46 2022] PUT /identity/v3/projects/d490483b5cc64ba0b5021ee96204079c/groups/7d9bf3c6956d4659aba3f12cca11a24d/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:18:47.518707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8de1a0-5d6a-457c-b2eb-1e8a4a8693da None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:47.519088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8de1a0-5d6a-457c-b2eb-1e8a4a8693da None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:47.519289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8de1a0-5d6a-457c-b2eb-1e8a4a8693da None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:47.520822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 212/416] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:47.526231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188631-28b6-4694-bf3e-991d13264493 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:47.526521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188631-28b6-4694-bf3e-991d13264493 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:47.526799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188631-28b6-4694-bf3e-991d13264493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:47.554574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-44188631-28b6-4694-bf3e-991d13264493 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:47.555784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-44188631-28b6-4694-bf3e-991d13264493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:47.658590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 205/417] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:47.824660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d114d94-95bd-48d2-a1d8-3e6c566b8048 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:47.825846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d114d94-95bd-48d2-a1d8-3e6c566b8048 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:47.825846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d114d94-95bd-48d2-a1d8-3e6c566b8048 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:47.827251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 213/418] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:47.832552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddd8fc-457b-4c6e-a160-19f21e0b0c41 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:47.832846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddd8fc-457b-4c6e-a160-19f21e0b0c41 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:47.833156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddd8fc-457b-4c6e-a160-19f21e0b0c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:47.863146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-57ddd8fc-457b-4c6e-a160-19f21e0b0c41 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:47.863339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-57ddd8fc-457b-4c6e-a160-19f21e0b0c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:47.959288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 206/419] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:48.001440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d114d94-95bd-48d2-a1d8-3e6c566b8048 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:48.078639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:48.139259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d114d94-95bd-48d2-a1d8-3e6c566b8048 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:48.188111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:48.189406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:48.189406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:48.189406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:48.209917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:48.214720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:48.215624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:48.216545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 214/420] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:48.226176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddd8fc-457b-4c6e-a160-19f21e0b0c41 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:48.264923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:48.336677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:48.397987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddd8fc-457b-4c6e-a160-19f21e0b0c41 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:48.435530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d6162-bbb1-40c3-8c40-9e862da6b549 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:48.440525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:48.441160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:48.441444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:48.441717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:48.442380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] RBAC: Adding query filter params (name=member) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:48.442683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:48.444047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:48.458438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:48.461782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 207/421] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:48.470046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:48.519530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75d12d-edd8-4623-bc30-f6d620303b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:48.520176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d12d-edd8-4623-bc30-f6d620303b8d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:48.520456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d12d-edd8-4623-bc30-f6d620303b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:48.520728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d12d-edd8-4623-bc30-f6d620303b8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:48.534765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75d12d-edd8-4623-bc30-f6d620303b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-cb75d12d-edd8-4623-bc30-f6d620303b8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:48.541497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:48.542441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:48.543222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:48.544373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 215/422] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:48.548305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05dc62-e6ab-4d1c-bfab-24ab5fb8b337 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:48.548305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05dc62-e6ab-4d1c-bfab-24ab5fb8b337 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:48.548305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05dc62-e6ab-4d1c-bfab-24ab5fb8b337 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:48.548305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 216/423] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:48.550514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05dc62-e6ab-4d1c-bfab-24ab5fb8b337 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:48.606199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff7703-e243-4167-8910-f9a3c715a696 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:48.634497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:48.653818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:48.654114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:48.654393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:48.654667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:48.695218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05dc62-e6ab-4d1c-bfab-24ab5fb8b337 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:48.735089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:48.736629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:48.745440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0891c-6f69-46d2-a8b1-225093f1ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:48.746352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0891c-6f69-46d2-a8b1-225093f1ba59 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:48.747851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0891c-6f69-46d2-a8b1-225093f1ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:48.748333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0891c-6f69-46d2-a8b1-225093f1ba59 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:48.749641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0891c-6f69-46d2-a8b1-225093f1ba59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:48.750455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0891c-6f69-46d2-a8b1-225093f1ba59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:48.752374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0891c-6f69-46d2-a8b1-225093f1ba59 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:48.765101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 217/424] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:48.766644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ec953-9f79-407a-9276-1b83dc3bc031 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:48.767135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ec953-9f79-407a-9276-1b83dc3bc031 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:48.767625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ec953-9f79-407a-9276-1b83dc3bc031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:48.791627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-137ec953-9f79-407a-9276-1b83dc3bc031 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:48.792860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-137ec953-9f79-407a-9276-1b83dc3bc031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:48.828672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:48.863983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 208/425] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:48.865195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:48.884773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 218/426] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:48.889811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ec953-9f79-407a-9276-1b83dc3bc031 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:48.898780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:49.036869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ec953-9f79-407a-9276-1b83dc3bc031 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.066769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be598e45-3ad4-4401-a3eb-f7bebdbe271e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.103074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.103684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.103963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.104233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.134368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.134934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.135210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.135477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.137720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:49.139153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:49.141080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 219/427] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:48 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:49.149982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:49.183891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:49.186183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:49.219075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:49.230037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:49.303958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 209/428] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:49.304968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:49.307114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf5ee-dc29-4a6f-a719-d3ec7b5629f2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.347014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.348006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.348484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.349273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.350615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:49.352238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:49.354348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 220/429] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:49 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:49.355398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:49.420591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf219c7-8b8d-4e17-9e3a-65ae5731a070 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.445457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:49.458810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.459452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.465899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.465899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.471209 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:49.476697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:49.477626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:49.478433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 210/430] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:49.479092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:49.486768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:49.491922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53af1c-8727-480d-b2db-7afcdc651adf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.535843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.536873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.537395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.537888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] PATH_INFO: `/v3/projects/ef95371881d74261aacce73d3647ecf0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.539326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] RBAC: Authorizing `identity:get_project(project_id=ef95371881d74261aacce73d3647ecf0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:49.541511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:49.544173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 221/431] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:49 2022] GET /identity/v3/projects/ef95371881d74261aacce73d3647ecf0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:49.545222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:49.601527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be0a53-f7b7-42ce-a131-9cf472c0877b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.641661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.642163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.642443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.642711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.643441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=ef95371881d74261aacce73d3647ecf0) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:49.643748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:49.645342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:49.657398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 211/432] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:49 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:49.658590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:49.673433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c5ba4-5b89-4072-be32-b18ad42cd94b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.720135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362abf9-7ac9-4652-82ab-7629b159eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.721172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362abf9-7ac9-4652-82ab-7629b159eaec None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.721462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362abf9-7ac9-4652-82ab-7629b159eaec None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.721738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362abf9-7ac9-4652-82ab-7629b159eaec None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.722773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362abf9-7ac9-4652-82ab-7629b159eaec None admin] RBAC: Adding query filter params (name=member) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:49.723241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362abf9-7ac9-4652-82ab-7629b159eaec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:49.724909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362abf9-7ac9-4652-82ab-7629b159eaec None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:49.726848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:49.738635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 222/433] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:49.741400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe605585-66b3-433e-a117-7bd5a15c718f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.741876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe605585-66b3-433e-a117-7bd5a15c718f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.742159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe605585-66b3-433e-a117-7bd5a15c718f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.744056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 223/434] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:49.744973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bc5d-38e4-4a58-809c-7ebfd18c3673 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.745277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bc5d-38e4-4a58-809c-7ebfd18c3673 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.745550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bc5d-38e4-4a58-809c-7ebfd18c3673 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.747289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 224/435] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:49.747989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0bc5d-38e4-4a58-809c-7ebfd18c3673 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:49.787124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:49.788265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba82c-3c5d-423f-8c53-7168843cf247 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.826404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5cba3-2616-420b-bb54-ad8ebe0d0dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.827067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5cba3-2616-420b-bb54-ad8ebe0d0dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.827348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5cba3-2616-420b-bb54-ad8ebe0d0dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.827627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5cba3-2616-420b-bb54-ad8ebe0d0dd5 None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.828824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5cba3-2616-420b-bb54-ad8ebe0d0dd5 None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:49.830340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5cba3-2616-420b-bb54-ad8ebe0d0dd5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:49.831962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 212/436] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:49 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:49.833183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917580-beb8-4ce2-907c-11d9841abdae None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.833470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917580-beb8-4ce2-907c-11d9841abdae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.833745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917580-beb8-4ce2-907c-11d9841abdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.853673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-04917580-beb8-4ce2-907c-11d9841abdae None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:49.855316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-04917580-beb8-4ce2-907c-11d9841abdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:49.885000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0bc5d-38e4-4a58-809c-7ebfd18c3673 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:49.929984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:49.930520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.930796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.931063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.939586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 213/437] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:49.939748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff023c-1e02-43a5-b89b-64c8588b1355 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:49.945804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff023c-1e02-43a5-b89b-64c8588b1355 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:49.945804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff023c-1e02-43a5-b89b-64c8588b1355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:49.963793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9cff023c-1e02-43a5-b89b-64c8588b1355 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:49.964972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9cff023c-1e02-43a5-b89b-64c8588b1355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:50.020030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:50.021413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.021542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:50.057252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.057564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 214/438] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:50.058755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff023c-1e02-43a5-b89b-64c8588b1355 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.152729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 225/439] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:50.158271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.182443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff023c-1e02-43a5-b89b-64c8588b1355 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.226484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.227563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.228035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.228557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.229528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=ef95371881d74261aacce73d3647ecf0) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:50.230127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:50.233240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:50.240275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 215/440] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=ef95371881d74261aacce73d3647ecf0&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:50.241352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.288669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ae901-5658-43fe-8dc2-848edc5d5810 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.303760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.322134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.332014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.332777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.333175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.333488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.334743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:50.336272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:50.338396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 226/441] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:50.344718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.396089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304f54-333a-44fa-822d-b188b931cbfe None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.434901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.435668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.436015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.436352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.448696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:50.456348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:50.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 216/442] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:50.458481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.469183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a825b-97ab-43ee-9f08-a0970d53d20e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.508303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.509356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.509835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.510402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.511828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:50.513411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:50.514983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 227/443] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:50.515937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.569655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.573646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82310-3ace-4374-a556-d0bb22ad119a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.592156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.615130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.615767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.616045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.616313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.628868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:50.634222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:50.635087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:50.635902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 217/444] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:50.636553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.642633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65f421-7e42-4a99-a1b9-9ed80c071a07 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.680294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.680898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.681216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.681482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.682135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:50.682432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:50.683787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:50.692362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 228/445] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:50.693100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.740540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad079e3-5ecb-4bf8-bac9-5b094d4db20c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.773791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.774417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.774696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.774966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.775681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=964027a7b5cf4ac5b2efd48eaa98c589, scope.project.id=d39e588d6aea463c98420ad4b9124284) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:50.775989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:50.777461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:50.783697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 218/446] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=964027a7b5cf4ac5b2efd48eaa98c589 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:50.784462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.798122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992e7c9-1434-4789-b429-b7a7337feeb8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.816654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.828546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:50.837444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.838071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.838357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.838630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.839316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:50.839629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:50.841704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:50.855145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 229/447] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:50.864818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:50.914962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af484-ac93-4090-b9a4-7b94b93e8c79 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:50.955049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:50.955596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:50.956040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:50.956312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:50.982799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b14e0-c6fc-4080-b1bd-3594d82fc330 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:51.025148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:51.025148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:51.025428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:51.027112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:51.039927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.041475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.067592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:51.103888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:51.119025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.120496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.156259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 219/448] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:51.162370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:51.232447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 230/449] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:51.238043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:51.263306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2aac2b-df25-4427-8c9f-1489746297fe None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:51.285534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:51.297007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:51.297666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:51.297941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:51.298217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] PATH_INFO: `/v3/projects/d39e588d6aea463c98420ad4b9124284` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:51.299505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=d39e588d6aea463c98420ad4b9124284)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.300744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.302535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 220/450] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:51 2022] GET /identity/v3/projects/d39e588d6aea463c98420ad4b9124284 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:51.307983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:51.324107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:51.339303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362128a0-49a0-474f-9dfc-33ed48314ae4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:51.374513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:51.375149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:51.375429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:51.375730 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] PATH_INFO: `/v3/projects/d490483b5cc64ba0b5021ee96204079c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:51.376846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] RBAC: Authorizing `identity:get_project(project_id=d490483b5cc64ba0b5021ee96204079c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.378324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.379941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 231/451] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:18:51 2022] GET /identity/v3/projects/d490483b5cc64ba0b5021ee96204079c => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:51.385369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:51.411178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0572-1e5b-442c-8806-3227ee029ad9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:51.443664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:51.444286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:51.444558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:51.444826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] PATH_INFO: `/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:51.445944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] RBAC: Authorizing `identity:get_group(group_id=a81ff94c5bce43d2ae3a6c304b86636e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.447363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.449086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 221/452] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:51 2022] GET /identity/v3/groups/a81ff94c5bce43d2ae3a6c304b86636e => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:51.455220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:51.482157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c7c7-8e9b-4cb1-ab2c-c1c70b55dce1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:51.510941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:51.515461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:51.516079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:51.516350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:51.516617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] PATH_INFO: `/v3/groups/7d9bf3c6956d4659aba3f12cca11a24d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:51.517732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] RBAC: Authorizing `identity:get_group(group_id=7d9bf3c6956d4659aba3f12cca11a24d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.519158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.520716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 232/453] 10.222.0.60 () {56 vars in 1180 bytes} [Fri Sep 9 21:18:51 2022] GET /identity/v3/groups/7d9bf3c6956d4659aba3f12cca11a24d => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:51.526403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:51.552176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:51.552400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc0dc-32a7-4d3f-92dd-18553fd9571c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:51.585483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a3cf-355b-455e-94ab-31f5674fbf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:51.586152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a3cf-355b-455e-94ab-31f5674fbf0d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:51.586375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a3cf-355b-455e-94ab-31f5674fbf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:51.586645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a3cf-355b-455e-94ab-31f5674fbf0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:51.587357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a3cf-355b-455e-94ab-31f5674fbf0d None admin] RBAC: Adding query filter params (group.id=a81ff94c5bce43d2ae3a6c304b86636e, role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=d39e588d6aea463c98420ad4b9124284) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:51.587665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a3cf-355b-455e-94ab-31f5674fbf0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.589103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a3cf-355b-455e-94ab-31f5674fbf0d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.595258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 222/454] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:51 2022] GET /identity/v3/role_assignments?group.id=a81ff94c5bce43d2ae3a6c304b86636e&scope.project.id=d39e588d6aea463c98420ad4b9124284&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:51.627229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f6866-d564-4adb-a52d-5399ebd7a5b4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:51.663982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30f9f-60c4-4dcc-8446-391446eca998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:51.664599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30f9f-60c4-4dcc-8446-391446eca998 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:51.664878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30f9f-60c4-4dcc-8446-391446eca998 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:51.665177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30f9f-60c4-4dcc-8446-391446eca998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:51.665919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30f9f-60c4-4dcc-8446-391446eca998 None admin] RBAC: Adding query filter params (group.id=7d9bf3c6956d4659aba3f12cca11a24d, role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=d490483b5cc64ba0b5021ee96204079c) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:51.666227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30f9f-60c4-4dcc-8446-391446eca998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:51.667670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30f9f-60c4-4dcc-8446-391446eca998 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:51.674263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 233/455] 10.222.0.60 () {56 vars in 1376 bytes} [Fri Sep 9 21:18:51 2022] GET /identity/v3/role_assignments?group.id=7d9bf3c6956d4659aba3f12cca11a24d&scope.project.id=d490483b5cc64ba0b5021ee96204079c&role.id=eea82d73b0db450f9f23e5256483a93e => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:54.370989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae602-b9d2-43e0-9512-17740c7c9595 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:54.372294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae602-b9d2-43e0-9512-17740c7c9595 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:54.372294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae602-b9d2-43e0-9512-17740c7c9595 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:54.373897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 223/456] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:54.379156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2644ce-aaa3-416b-9f9a-9d68ec8c1f40 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:54.379627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2644ce-aaa3-416b-9f9a-9d68ec8c1f40 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:54.379727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2644ce-aaa3-416b-9f9a-9d68ec8c1f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:54.419105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9a2644ce-aaa3-416b-9f9a-9d68ec8c1f40 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:54.420390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9a2644ce-aaa3-416b-9f9a-9d68ec8c1f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:54.515395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 234/457] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:54.533551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455b33-b286-4e8e-ae09-eb8d7350a059 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:54.534148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455b33-b286-4e8e-ae09-eb8d7350a059 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:54.534617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455b33-b286-4e8e-ae09-eb8d7350a059 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:54.536163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 224/458] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:54.541547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad3ab2-9934-4326-9eda-408a064602a7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:54.542060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad3ab2-9934-4326-9eda-408a064602a7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:54.542543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad3ab2-9934-4326-9eda-408a064602a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:54.569659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9dad3ab2-9934-4326-9eda-408a064602a7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:54.571152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9dad3ab2-9934-4326-9eda-408a064602a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:54.585500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:54.658000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 235/459] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:54.913504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455b33-b286-4e8e-ae09-eb8d7350a059 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:54.925224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ece8a-50aa-476e-b8a7-b6fc80c6c2dd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:54.925506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ece8a-50aa-476e-b8a7-b6fc80c6c2dd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:54.925786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ece8a-50aa-476e-b8a7-b6fc80c6c2dd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:54.928492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 236/460] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:54.932891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96044999-c0d4-4347-979b-a0325ddf09d0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:54.933204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96044999-c0d4-4347-979b-a0325ddf09d0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:54.933784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96044999-c0d4-4347-979b-a0325ddf09d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:54.954485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-96044999-c0d4-4347-979b-a0325ddf09d0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:54.955678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-96044999-c0d4-4347-979b-a0325ddf09d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:55.036296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 237/461] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:55.037299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96044999-c0d4-4347-979b-a0325ddf09d0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:55.065970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455b33-b286-4e8e-ae09-eb8d7350a059 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.113469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:55.122617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:55.138216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.138909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.139193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.139464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.146124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96044999-c0d4-4347-979b-a0325ddf09d0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.150344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.151814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:18:55.171245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:55.172168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:18:55.173043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:18:55.173043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:55.173043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:55.173043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 225/462] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:55.186143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:55.207625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.208279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.208795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.209092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.231307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.232764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:18:55.262940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:55.263873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:18:55.264687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:18:55.264687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:55.264687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:55.264687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 238/463] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:55.270228 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:55.363954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2b4f-2886-4f70-8fdc-05fd542f81d8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.375523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfd0f-95a5-4bb5-af54-4bbb4590e3a9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.399334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebc7e0-617d-446d-876f-6da7c01043a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.399972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc7e0-617d-446d-876f-6da7c01043a3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.400268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc7e0-617d-446d-876f-6da7c01043a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.400573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebc7e0-617d-446d-876f-6da7c01043a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.401281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebc7e0-617d-446d-876f-6da7c01043a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:55.401613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebc7e0-617d-446d-876f-6da7c01043a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.403549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebc7e0-617d-446d-876f-6da7c01043a3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.407170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:55.412799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.413426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.413708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.421010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.421010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:55.421010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.421316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 226/464] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:55.421398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.421476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e4a1-38c4-4007-98b5-4abe6beee942 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.421476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e4a1-38c4-4007-98b5-4abe6beee942 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.421476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e4a1-38c4-4007-98b5-4abe6beee942 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.423634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 227/465] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:55.424422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892e4a1-38c4-4007-98b5-4abe6beee942 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:55.430850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 239/466] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:55.430850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:55.463342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:55.533661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892e4a1-38c4-4007-98b5-4abe6beee942 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.540407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3b5b3-08d4-4771-a288-4258baca6dc2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.570916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0875ab-ca9f-4ca1-848d-acbb5e306edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.571534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0875ab-ca9f-4ca1-848d-acbb5e306edc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.571817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0875ab-ca9f-4ca1-848d-acbb5e306edc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.572085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0875ab-ca9f-4ca1-848d-acbb5e306edc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.577336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.577944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.578219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.578487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.579125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.580540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.583243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0875ab-ca9f-4ca1-848d-acbb5e306edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.584699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0875ab-ca9f-4ca1-848d-acbb5e306edc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3b0875ab-ca9f-4ca1-848d-acbb5e306edc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:18:55.601275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:55.607316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:18:55.608177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:18:55.608177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:55.608177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:55.608177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 228/467] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:55.608177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb6e7-04d0-480b-9c62-d6be3900e35a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.608177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb6e7-04d0-480b-9c62-d6be3900e35a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.608177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb6e7-04d0-480b-9c62-d6be3900e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.624056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fb3bb6e7-04d0-480b-9c62-d6be3900e35a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:55.625383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fb3bb6e7-04d0-480b-9c62-d6be3900e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:55.678135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 240/468] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:55 2022] POST /identity/v3/users => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:55.679016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:55.702329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 229/469] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:55.703490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb6e7-04d0-480b-9c62-d6be3900e35a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:55.727882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:55.752296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:55.820508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37b63-262b-4b65-87b9-e8f7636c2001 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.843376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb6e7-04d0-480b-9c62-d6be3900e35a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:55.876320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27583d25-1e06-418b-b22c-f9ee94dc474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.877331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27583d25-1e06-418b-b22c-f9ee94dc474d None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.877760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27583d25-1e06-418b-b22c-f9ee94dc474d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.878180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27583d25-1e06-418b-b22c-f9ee94dc474d None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.879013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27583d25-1e06-418b-b22c-f9ee94dc474d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.880898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27583d25-1e06-418b-b22c-f9ee94dc474d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.917047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:55.917913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:55.919100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:55.919708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:55.920648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:55.921133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:55.922710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:55.937697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 230/470] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:55.946135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:56.026424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:56.050146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31786be5-4990-4481-b536-7059c57d3ffc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:56.084784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cc9e7-f634-4204-a6e5-c71e802b1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:56.085517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cc9e7-f634-4204-a6e5-c71e802b1e08 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:56.085859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cc9e7-f634-4204-a6e5-c71e802b1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:56.086194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cc9e7-f634-4204-a6e5-c71e802b1e08 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:56.086922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cc9e7-f634-4204-a6e5-c71e802b1e08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:56.088427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cc9e7-f634-4204-a6e5-c71e802b1e08 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:56.088899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 241/471] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:55 2022] POST /identity/v3/users => generated 248 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:56.090968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee478-84fc-44a9-83f3-6e1f00673efe None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:56.097011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee478-84fc-44a9-83f3-6e1f00673efe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:56.097011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee478-84fc-44a9-83f3-6e1f00673efe None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:56.097548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 242/472] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:56.099027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ee478-84fc-44a9-83f3-6e1f00673efe None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:56.176749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 231/473] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:55 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:18:56.182106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653807-59eb-47ea-8ed0-04c3d473bf05 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:56.182494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653807-59eb-47ea-8ed0-04c3d473bf05 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:56.182782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653807-59eb-47ea-8ed0-04c3d473bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:56.220211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c4653807-59eb-47ea-8ed0-04c3d473bf05 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:56.221502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c4653807-59eb-47ea-8ed0-04c3d473bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:56.278052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ee478-84fc-44a9-83f3-6e1f00673efe None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:56.280482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:56.321767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:56.322483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:56.322763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:56.323037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:56.334978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:56.336468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:56.337977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 232/474] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:18:56.358952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:56.360123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:18:56.361256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:18:56.361256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:56.361256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:56.361256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 243/475] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:56.367136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4653807-59eb-47ea-8ed0-04c3d473bf05 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:56.439240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:56.479814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4653807-59eb-47ea-8ed0-04c3d473bf05 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:56.519035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:56.519660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:56.519941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:56.520214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:56.520863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:56.521198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:56.522585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:56.536931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 233/476] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:56.542012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:56.652436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:56.653404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5bf61-5eac-40d3-aa23-72f2991b8248 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:56.705956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:56.706585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:56.707254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:56.707549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:56.708212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:56.709974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:56.776112 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683ccd-be8f-4a7b-a351-1adb22665883 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:56.801982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:56.814348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:56.815402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:56.815885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:56.816389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:56.817301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:56.819042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:56.833190 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 244/477] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:18:56 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:18:56.849421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.sql.core [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 21:18:56.849421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 21:18:56.849421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [parameters: {'id': 'ae30df17dd024644b8c1b780bcbea4cf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 21:18:56.849421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Sep 09 21:18:56.868625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 21:18:56.869962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application yield resource Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise self.value Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application session.commit() Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 21:18:56.870890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.flush() Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application compat.raise_( Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 21:18:56.873019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 21:18:56.874305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 21:18:56.876369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [parameters: {'id': 'ae30df17dd024644b8c1b780bcbea4cf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:56.878401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 21:18:56.880566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:56.888369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 234/478] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Sep 9 21:18:56 2022] POST /identity/v3/roles => generated 144 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:56.891302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:56.915106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:57.019809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2487fb-bda1-4acc-b7d3-8023573ff0c9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:57.060485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295d74e-4891-4a5e-97dd-aadeb685b1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:57.061063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295d74e-4891-4a5e-97dd-aadeb685b1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:57.061399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295d74e-4891-4a5e-97dd-aadeb685b1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:57.061676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295d74e-4891-4a5e-97dd-aadeb685b1d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:57.072325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295d74e-4891-4a5e-97dd-aadeb685b1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c295d74e-4891-4a5e-97dd-aadeb685b1d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:57.077914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:57.078789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:57.079982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 245/479] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:18:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:57.084979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:57.190430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f372d-6971-4d2b-83b0-555d48e378da None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:57.225607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469485-383e-442b-a453-44e879b3246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:57.226226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469485-383e-442b-a453-44e879b3246f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:57.226505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469485-383e-442b-a453-44e879b3246f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:57.226780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469485-383e-442b-a453-44e879b3246f None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:57.227452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469485-383e-442b-a453-44e879b3246f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:57.227754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469485-383e-442b-a453-44e879b3246f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:57.229167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28469485-383e-442b-a453-44e879b3246f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:57.238959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 235/480] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:18:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:58.361251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91421-ca98-4d19-b04c-53e068a99efc None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:58.361795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91421-ca98-4d19-b04c-53e068a99efc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:58.361795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91421-ca98-4d19-b04c-53e068a99efc None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:58.363366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 246/481] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:58.368540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75244c6f-684c-41f9-bc33-3c69e2cfcdfc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:58.368934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75244c6f-684c-41f9-bc33-3c69e2cfcdfc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:58.369157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75244c6f-684c-41f9-bc33-3c69e2cfcdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:58.394033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-75244c6f-684c-41f9-bc33-3c69e2cfcdfc None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:58.395218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-75244c6f-684c-41f9-bc33-3c69e2cfcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:58.457373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:58.491319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 236/482] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:58.880989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91421-ca98-4d19-b04c-53e068a99efc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:58.977431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:59.008240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc119beb-7717-4235-9028-3a415ffe8723 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.008526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc119beb-7717-4235-9028-3a415ffe8723 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.008803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc119beb-7717-4235-9028-3a415ffe8723 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.009523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91421-ca98-4d19-b04c-53e068a99efc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:59.010437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 237/483] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:59.017053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660607c-4a02-42d6-8929-578b985987a0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.017053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660607c-4a02-42d6-8929-578b985987a0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.017053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660607c-4a02-42d6-8929-578b985987a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.051646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f660607c-4a02-42d6-8929-578b985987a0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:59.052854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f660607c-4a02-42d6-8929-578b985987a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:59.079607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f39ae-be8e-4f07-bdb0-ace055978e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:59.080620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f39ae-be8e-4f07-bdb0-ace055978e45 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.081192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f39ae-be8e-4f07-bdb0-ace055978e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.081776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f39ae-be8e-4f07-bdb0-ace055978e45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.093858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f39ae-be8e-4f07-bdb0-ace055978e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-433f39ae-be8e-4f07-bdb0-ace055978e45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:59.099796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:59.100753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:18:59.101582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:59.104201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 247/484] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:18:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:59.105885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10161c4-6b11-4cab-aa89-0e614333ea65 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.106367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10161c4-6b11-4cab-aa89-0e614333ea65 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.106942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10161c4-6b11-4cab-aa89-0e614333ea65 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.108369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 248/485] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:59.113433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10161c4-6b11-4cab-aa89-0e614333ea65 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:59.128463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 238/486] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:18:59.138384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc9bb-a14e-4cb7-b521-fd824be9276d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.138721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc9bb-a14e-4cb7-b521-fd824be9276d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.139008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc9bb-a14e-4cb7-b521-fd824be9276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.169660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f77fc9bb-a14e-4cb7-b521-fd824be9276d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:18:59.171913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f77fc9bb-a14e-4cb7-b521-fd824be9276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:18:59.258911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10161c4-6b11-4cab-aa89-0e614333ea65 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:59.299798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 239/487] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:59.321374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:59.324026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:59.325371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.325743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.326106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.326918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:59.327315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:59.328749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:59.340463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 249/488] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:18:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:18:59.346232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc9bb-a14e-4cb7-b521-fd824be9276d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:59.400677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:59.454761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:59.489443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc9bb-a14e-4cb7-b521-fd824be9276d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:59.552363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:59.553398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.554025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.554497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.574786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:59.578825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:18:59.606439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:59.607383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:18:59.608233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:18:59.608233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:18:59.608233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:18:59.616287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 240/489] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:59.620529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:59.638650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620838d-94d5-4510-b47a-e77aa135f0ac None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:59.698621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:59.699678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.700158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.700639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.715577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:59.725474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:59.726374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:18:59.727167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:59.729937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 250/490] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:18:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:18:59.735862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:59.769293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:59.781629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef13bd-6105-4c13-832e-ec02c8f9e798 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:59.799745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:59.817836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:59.818445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.818718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.818992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.819627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:59.819932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:18:59.821332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:18:59.833632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 241/491] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:18:59.834384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:59.850829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a532-38e4-4a76-98a6-e15964e7aca8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:59.885901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1bb24-9813-4dde-ae18-a7aa8047e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:59.886564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1bb24-9813-4dde-ae18-a7aa8047e361 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.886835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1bb24-9813-4dde-ae18-a7aa8047e361 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.887107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1bb24-9813-4dde-ae18-a7aa8047e361 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.897768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1bb24-9813-4dde-ae18-a7aa8047e361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-78b1bb24-9813-4dde-ae18-a7aa8047e361 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:18:59.903812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:18:59.905888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 251/492] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:18:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:18:59.906702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642f2d-0df3-433e-b69c-c6dfaf017f27 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.907449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642f2d-0df3-433e-b69c-c6dfaf017f27 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.907449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642f2d-0df3-433e-b69c-c6dfaf017f27 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.912184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 252/493] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:18:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:18:59.912184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642f2d-0df3-433e-b69c-c6dfaf017f27 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:18:59.955594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df182d8b-45b4-4800-bc72-4bd9b867bc1d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:18:59.996515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:18:59.997331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:18:59.997610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:18:59.997880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:18:59.998890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:18:59.999224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.000923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.008910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 242/494] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:18:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:00.009727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.027727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.029944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642f2d-0df3-433e-b69c-c6dfaf017f27 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.045904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.068148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04ce9-2584-4b15-8261-77ccbbac34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.068477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04ce9-2584-4b15-8261-77ccbbac34d0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.068753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04ce9-2584-4b15-8261-77ccbbac34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.069022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04ce9-2584-4b15-8261-77ccbbac34d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.076336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b04ce9-2584-4b15-8261-77ccbbac34d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.077849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b04ce9-2584-4b15-8261-77ccbbac34d0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b5b04ce9-2584-4b15-8261-77ccbbac34d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:00.093393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:00.094469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:00.095365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 253/495] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:18:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:00.096096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0bf6-0cff-440a-b3c9-9312dfddc9ba None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.096096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0bf6-0cff-440a-b3c9-9312dfddc9ba None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.096217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0bf6-0cff-440a-b3c9-9312dfddc9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.114723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0d2d0bf6-0cff-440a-b3c9-9312dfddc9ba None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:00.115916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0d2d0bf6-0cff-440a-b3c9-9312dfddc9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:00.121418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7222a-c83b-43c6-b652-e0c8f3e49b9f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.154826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.155427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.155705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.155978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.156639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:00.156942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.158350 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.166246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 243/496] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:00.167019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.184440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 254/497] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:00.185691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f0691-d587-4b2f-8982-859d1b2e43d4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.185981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f0691-d587-4b2f-8982-859d1b2e43d4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.186261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f0691-d587-4b2f-8982-859d1b2e43d4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.187464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 255/498] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:00.188139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f0691-d587-4b2f-8982-859d1b2e43d4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.246561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.270877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c3020-5ed6-4e71-aa77-df4e3d1ed05d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.304058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f0691-d587-4b2f-8982-859d1b2e43d4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.304927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.305585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.305851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.305949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.306115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.318275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.320261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:00.338088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:00.338978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:00.340498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:00.340498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:00.340498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:00.340498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 244/499] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:00.340498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.346763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f67f-35e7-4975-bfe9-5057c6adf1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.347378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f67f-35e7-4975-bfe9-5057c6adf1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.347656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f67f-35e7-4975-bfe9-5057c6adf1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.347925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f67f-35e7-4975-bfe9-5057c6adf1a3 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.348898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f67f-35e7-4975-bfe9-5057c6adf1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:00.349236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f67f-35e7-4975-bfe9-5057c6adf1a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.350658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f67f-35e7-4975-bfe9-5057c6adf1a3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.390630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 256/500] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:00.392143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c061b-bb7f-41aa-b65a-053eed205737 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.392427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c061b-bb7f-41aa-b65a-053eed205737 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.392698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c061b-bb7f-41aa-b65a-053eed205737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.412204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e05c061b-bb7f-41aa-b65a-053eed205737 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:00.413441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e05c061b-bb7f-41aa-b65a-053eed205737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:00.463574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29bad-c6b5-44e8-9c27-1da849df182b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.482226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 257/501] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:00.483056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c061b-bb7f-41aa-b65a-053eed205737 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.490018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.500384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.500950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.501262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.501534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.512641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.514113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:00.528528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:00.529628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:00.530937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:00.530937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:00.530937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:00.530937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 245/502] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:00.530937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.588822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.600753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c061b-bb7f-41aa-b65a-053eed205737 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.634840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1b8d6-a996-4cd8-bb27-c7460a1daaf1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.638446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.638722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.639014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.639273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.639913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:00.640213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.641626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.658700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 258/503] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:00.658700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.674577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.675187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.675467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.675736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.723746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.747090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.748552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:00.765524 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd2de9-81fd-463d-bcad-3f70b8a3983d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.798618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.799247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.799525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.799795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.810123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:00.815454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:00.816404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:00.817290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 259/504] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:00.817933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.829602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.852632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 246/505] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:00.853508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:00.921555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404bb49-61ed-4424-8461-9349559b03a3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.934141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.954940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039298ae-4a49-4838-97eb-a4d336a515a1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:00.987964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:00.988604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:00.988874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:00.989172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:00.996048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:00.997530 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:01.009954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:01.010973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:01.012584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 247/506] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:01.013314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.019330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.019879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.020152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.020540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.021209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:01.021511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.022902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.035250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 260/507] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:01.036187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.109471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.112611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37ba2-842a-4b6d-bfc6-9e3d629c9d35 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.138773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d129260-91cb-423c-a817-c0c0199d63b3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.145773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.146397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.146675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.146950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.154524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.158213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.159670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.172575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.173290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.173562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:01.173772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:01.174753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:01.175605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:01.175605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:01.175605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:01.175798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.175798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:01.175798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.175971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 248/508] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:01.175971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.176162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.189171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 261/509] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:01.189171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.281801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae51d9-ac47-478e-8c3d-4dd135c2e2b1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.283329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1a44f-eb4b-409a-a99a-66965c73ad72 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.310377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.313567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.314192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.314475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.314740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.314967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.315571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.315850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.316121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.316840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:01.317199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.318648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.325837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.327266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.335779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 262/510] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:01.336570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:01.342052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:01.343093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:01.343945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:01.343945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:01.343945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:01.343945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 249/511] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:01.343945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.388049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.435009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7386-142e-460d-8a19-62e3fbf82019 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.443354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206b633-cc25-42da-ba76-759e9701cc66 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.467910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.468544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.468827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.469139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.476154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.476660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.477314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.477596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.477703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.477869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.478531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:01.478832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.480258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:01.488920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:01.490180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 21:19:01.491185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:01.491929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 263/512] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:01.493136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 250/513] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:01.493246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.493319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.544643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.594596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412246b-fa37-4eea-af28-cf3d11edb040 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.596060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b2f1-397b-43da-bf2c-d7d5daedbf30 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.597723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.631959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.632559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.632836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.633140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.633235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.633814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.634097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.634370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.645758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.647208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:01.661145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:01.662198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:01.663219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:01.663219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:01.663219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:01.663219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 264/514] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:01.663462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.703548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.705011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.763790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e201b-1526-43e7-931d-3be18c571793 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.765406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.797390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.797917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.798194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.798461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.799087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:01.799381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.800909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.803121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 251/515] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:01.804007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.806406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:01.815750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 265/516] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:01.815750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:01.906802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c104b-3293-4adf-9c84-cb89cc2706ec None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.913884 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c31079-d458-49d5-b1bd-368d7447b3b6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:01.939915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.940519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.940800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.941101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.941870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:01.942176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.943646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.946726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:01.947329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:01.952281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:01.952281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:01.952281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:01.952281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:01.980134 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 252/517] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:01.981581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.026375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 266/518] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:19:01 2022] POST /identity/v3/users => generated 247 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:02.027277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.048996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.049771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.099086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df357ed0-c1fb-4569-81a6-99caf3a7ba96 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.142416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ea507-a806-46f4-9792-63f3d620d117 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.142831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.143460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.143748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.144027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.144688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:02.145000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.146462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.161001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 253/519] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:02.161902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.188645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.189328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.189651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.189929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.203888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.205062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:02.220719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:02.221764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:02.222617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:02.222617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:02.222617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:02.224374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 267/520] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:02.225523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.281846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426424ae-ae24-4713-af73-01236f3336e6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.301083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.302950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.319402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.320035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.320318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.320592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.328735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.330253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.335365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd3a7-bbd1-4af6-bef0-403520b1d3f5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:02.343063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:02.344127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:02.345341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:02.349233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 254/521] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:02.350090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.373952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.374700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.375048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.375320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.448406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.450647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.461308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c549c-7dab-480b-ac92-978c5997fa05 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.497496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.498273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.498650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.498992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.507067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.508585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:02.519652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:02.520750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 21:19:02.521988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:02.522622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 255/522] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:02.523328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.530574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.566706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.572309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 268/523] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:02.572309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.640317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cc7ab-24c0-49e4-a05b-6d8dce633abb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.675844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757b1e-b5d7-4ee1-8f41-67b109e3fa07 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.677889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.679241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.679525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.679803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.680448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:02.680754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.682161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.701487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 256/524] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:02.701487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.712150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.712760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.713054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.713338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.714018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:02.714319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.716271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.738962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 269/525] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:02.738962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.774744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.811330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:02.814141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7423-56f3-41a0-aaca-aaf70fc5ec5a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.851740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.851918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c43ab-0e2c-4ff0-9910-039f717dfe59 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:02.852285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.852564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.852838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.853886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:02.855287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.858721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.885217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 257/526] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:02.885217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.889342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:02.890088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:02.890463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:02.890833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:02.901737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:02.904331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:02.920641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:02.921848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:02.922916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:02.922916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:02.922916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:02.928838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 270/527] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:02.928838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:02.998858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb53b5-9a36-47cc-8b3d-b7153e2deb44 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.020421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.034132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.034763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.035041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.035307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.040442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ebdd1-7c66-4e1a-a8ec-2021c024fd9b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.041946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.043458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:03.054585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:03.055410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:03.056259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 258/528] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:03.056712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.077072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.080958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.081597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.081880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.082153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.082876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=97eb6832e7d246d6b6f1813763ac8a74) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:03.083182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.084604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.101327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 271/529] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:02 2022] GET /identity/v3/role_assignments?user.id=97eb6832e7d246d6b6f1813763ac8a74&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:03.101327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.180913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4050e-48ce-47b2-9178-bbca469770db None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.217352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3adbb-f008-401a-b78e-a90917673ff6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.227237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.227973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.228813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.229198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.264407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.265362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.265648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.265924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.266788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:03.267100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.269312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.286764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 272/530] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:03.288052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.300613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.316361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.317870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.339387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.435114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 259/531] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:03.435114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.442009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2db22-51c9-4025-aa64-8d9bddadbd08 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.481112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.481744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.482019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.482285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.482963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:03.483264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.484677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.497463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 273/532] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:03.498456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.567923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0252-adb9-4dd5-b5ea-2c39870ef44c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.569364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.593478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.608013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24646-4b30-482f-8c59-9afe70c2f693 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.617087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.618498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.619027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.619925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.631211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.633814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.647635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.648267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.648545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.648816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:03.651979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:03.652815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:03.653702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:03.656005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 260/533] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:03.657605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.661169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.663236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:03.679107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:03.680090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:03.680935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:03.680935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:03.680935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:03.685344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 274/534] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:03.686259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.794741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33bb13-154c-4eb9-b777-6cbcd6575ad4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.802372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3ffef-c378-450c-a7a3-27527ebc18cd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:03.820836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.838441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.839053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.839428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.840374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.841309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:03.841710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.843727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.855419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:03.857652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:03.858120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:03.858586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:03.862285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=1852c201959444ca8066470206aa6167) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:03.862556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 275/535] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:03.862999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:03.863643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.864963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:03.873863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 261/536] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/role_assignments?user.id=1852c201959444ca8066470206aa6167&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:03.875529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:03.974641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:04.032848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e387ec-c297-46ce-8aa8-423ac031330e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:04.070899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:04.071519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:04.071794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:04.072061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:04.072705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:04.073004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:04.074469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:04.086619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 276/537] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:04.092762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:04.096876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976179-a619-4fbb-a73c-9231ac632794 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:04.136776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:04.160021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:04.160644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:04.160927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:04.161229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:04.161962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=3d284f9dd17546208bc48aa269c56fe8) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:04.162269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:04.163715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:04.175992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 262/538] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:03 2022] GET /identity/v3/role_assignments?user.id=3d284f9dd17546208bc48aa269c56fe8&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:04.196926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212768b-43e9-489b-821e-b2f855e355a5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:04.237551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4649-e252-4c83-a948-c56c6df8ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:04.238233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4649-e252-4c83-a948-c56c6df8ccfb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:04.238509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4649-e252-4c83-a948-c56c6df8ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:04.238776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4649-e252-4c83-a948-c56c6df8ccfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:04.246855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4649-e252-4c83-a948-c56c6df8ccfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:04.248286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4649-e252-4c83-a948-c56c6df8ccfb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-5eda4649-e252-4c83-a948-c56c6df8ccfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:04.260546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:04.261719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:04.262603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 277/539] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:04.267602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:04.334389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855804-7b70-474e-9f19-5ad89eabe729 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:04.334389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855804-7b70-474e-9f19-5ad89eabe729 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:04.334389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855804-7b70-474e-9f19-5ad89eabe729 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:04.335137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 278/540] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:04.341677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d0ce-d84d-477f-b80c-b1725a40beb5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:04.342716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d0ce-d84d-477f-b80c-b1725a40beb5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:04.343358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d0ce-d84d-477f-b80c-b1725a40beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:04.364812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-90d7d0ce-d84d-477f-b80c-b1725a40beb5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:04.366431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-90d7d0ce-d84d-477f-b80c-b1725a40beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:04.448072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904832c-edad-41d4-b205-8a9f0ad4efa7 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:04.456811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:04.479244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 279/541] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:19:04.490081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:04.490995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:04.491480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:04.491989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:04.492887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:04.497519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:04.499140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:04.522603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 263/542] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:04.533056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d0ce-d84d-477f-b80c-b1725a40beb5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:04.562684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:04.663012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d0ce-d84d-477f-b80c-b1725a40beb5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:04.704927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:04.705561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:04.705835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:04.706105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:04.706833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=cf39db40dace49cbba29c0596cbe76bb) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:04.707139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:04.708547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:04.718237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 280/543] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:04 2022] GET /identity/v3/role_assignments?user.id=cf39db40dace49cbba29c0596cbe76bb&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:04.897046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:05.025204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe442-d1ed-47f5-9478-e17e0c42c3ed None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:05.070517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:05.071155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:05.071431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:05.071701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:05.082232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:05.086943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:05.088042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:05.088847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 264/544] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:05.094781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:05.258313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:05.268698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97868d5-fb15-40e1-9e07-4ec599799d2f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:05.313424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:05.314031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:05.314312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:05.314590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:05.315248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:05.315550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:05.316899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:05.328590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 281/545] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:05.334226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:05.379032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:05.459276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf607a-3ded-414f-8488-b17ead3a82e7 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:05.502247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df982bb-90ee-405d-a3c7-de18fc00fc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:05.502878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df982bb-90ee-405d-a3c7-de18fc00fc98 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:05.503157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df982bb-90ee-405d-a3c7-de18fc00fc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:05.503423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df982bb-90ee-405d-a3c7-de18fc00fc98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:05.517865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df982bb-90ee-405d-a3c7-de18fc00fc98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:05.519316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df982bb-90ee-405d-a3c7-de18fc00fc98 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-8df982bb-90ee-405d-a3c7-de18fc00fc98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:05.539195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:05.540222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:05.541091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:05.541091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:05.541091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:05.545179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 265/546] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:05.550314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:05.703945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6173-c853-46bd-83c9-b7101e80256c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:05.735972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c8c0-a3ec-44c4-8d39-2516769c48b7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:05.736395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c8c0-a3ec-44c4-8d39-2516769c48b7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:05.736571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c8c0-a3ec-44c4-8d39-2516769c48b7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:05.738123 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 266/547] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:05.742986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb910a6-d23e-4f0b-91f3-9cfe38db1d12 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:05.743200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb910a6-d23e-4f0b-91f3-9cfe38db1d12 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:05.743454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb910a6-d23e-4f0b-91f3-9cfe38db1d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:05.744474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:05.745103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:05.745465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:05.745695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:05.746838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:05.747191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:05.748488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:05.761151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 282/548] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:05.767972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-deb910a6-d23e-4f0b-91f3-9cfe38db1d12 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:05.769173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-deb910a6-d23e-4f0b-91f3-9cfe38db1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:05.770037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:05.789761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:05.897374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 267/549] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:19:05.939720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814842d-20b5-4567-b4b0-f7dbbf759f46 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:05.976285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:05.976966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:05.977283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:05.977556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:05.984997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:05.986531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:05.998833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:05.999751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:06.000684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 283/550] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:06.005930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb910a6-d23e-4f0b-91f3-9cfe38db1d12 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:06.017894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:06.137628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb910a6-d23e-4f0b-91f3-9cfe38db1d12 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:06.174658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:06.175254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.175533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.175802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.176633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:06.176943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:06.178451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:06.202520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 268/551] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Sep 9 21:19:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:06.208495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:06.268035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:06.334545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:06.380059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417a72d-6c12-422f-aa54-64c705ddf3c2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:06.412488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:06.437617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951dd1b-1bfd-4f37-ac1f-581cf084762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:06.438229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951dd1b-1bfd-4f37-ac1f-581cf084762e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.438506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951dd1b-1bfd-4f37-ac1f-581cf084762e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.438772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951dd1b-1bfd-4f37-ac1f-581cf084762e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.477811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052575a-cfb8-43f1-a4f5-66c1663b1f56 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:06.534532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:06.535160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.535603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.536016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.553054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:06.555453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:06.556506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:06.557429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:06.558316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 269/552] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:06.564168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:06.579525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951dd1b-1bfd-4f37-ac1f-581cf084762e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:06.581176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951dd1b-1bfd-4f37-ac1f-581cf084762e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:06.689670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfca2-a0c0-486e-b547-630c8ea2fff4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:06.703051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:06.729430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:06.733529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:06.734309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.734900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.735190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.736142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:06.736450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:06.738332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:06.741637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 284/553] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:06.743130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fa698-dfdc-4e8b-bbf0-fcb2bcca17da None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.743538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fa698-dfdc-4e8b-bbf0-fcb2bcca17da None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.743911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fa698-dfdc-4e8b-bbf0-fcb2bcca17da None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.748240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 270/555] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:06.749106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:06.750125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 285/555] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:06.751437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833c3a-5c66-48a2-977c-8f31ee0d65e7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.751793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833c3a-5c66-48a2-977c-8f31ee0d65e7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.752073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833c3a-5c66-48a2-977c-8f31ee0d65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.772186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dc833c3a-5c66-48a2-977c-8f31ee0d65e7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:06.774669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dc833c3a-5c66-48a2-977c-8f31ee0d65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:06.877318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 286/556] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:06.878568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc833c3a-5c66-48a2-977c-8f31ee0d65e7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:06.885796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04cfd-11d9-4b5a-b3f6-874dc6fde058 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:06.929263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb698c7-d8eb-4e44-ad22-b09d39b53a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:06.929885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb698c7-d8eb-4e44-ad22-b09d39b53a13 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.930163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb698c7-d8eb-4e44-ad22-b09d39b53a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.930425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb698c7-d8eb-4e44-ad22-b09d39b53a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.941714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb698c7-d8eb-4e44-ad22-b09d39b53a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:06.943103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb698c7-d8eb-4e44-ad22-b09d39b53a13 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-5bb698c7-d8eb-4e44-ad22-b09d39b53a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:06.958752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:06.959770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:06.960637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:06.960637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:06.960637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:06.965355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 271/557] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:06.966805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef307c48-7105-4b2a-a8fa-663cd19e6403 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:06.967087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef307c48-7105-4b2a-a8fa-663cd19e6403 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:06.967359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef307c48-7105-4b2a-a8fa-663cd19e6403 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:06.972967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 272/558] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:06.974041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef307c48-7105-4b2a-a8fa-663cd19e6403 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.014428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc833c3a-5c66-48a2-977c-8f31ee0d65e7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.019996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.020707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.057367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e4bb-325d-4510-9e6a-a0550ba9f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.058169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e4bb-325d-4510-9e6a-a0550ba9f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.059553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e4bb-325d-4510-9e6a-a0550ba9f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.059856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e4bb-325d-4510-9e6a-a0550ba9f8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.072667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e4bb-325d-4510-9e6a-a0550ba9f8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.075163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e4bb-325d-4510-9e6a-a0550ba9f8a4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.081292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef307c48-7105-4b2a-a8fa-663cd19e6403 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-fa43e4bb-325d-4510-9e6a-a0550ba9f8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:07.094898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:07.095848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:07.096732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:07.096732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:07.096732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:07.101430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 287/559] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:07.102946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9cfa-b383-4eee-a144-a77a8a944e19 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.103231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9cfa-b383-4eee-a144-a77a8a944e19 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.103510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9cfa-b383-4eee-a144-a77a8a944e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.125221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.125981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.126357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.126732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.127492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:07.127897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.129000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c8fb9cfa-b383-4eee-a144-a77a8a944e19 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:07.129484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.130315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c8fb9cfa-b383-4eee-a144-a77a8a944e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:07.147770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 273/560] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:07.148669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.221444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 288/561] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:07.221444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9cfa-b383-4eee-a144-a77a8a944e19 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.259576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.262989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4507b-b7e2-42a4-9c09-e402c7ad61a3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.299432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.300055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.300341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.300607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.301276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:07.301586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.302978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.316817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 274/562] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:07.317741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.323940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.341741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9cfa-b383-4eee-a144-a77a8a944e19 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.382510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.383457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.383809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.384088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.392187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.393654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:07.405813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:07.406701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 289/563] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:07.407631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.425319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412efc1-8c89-4663-af7c-baf890be61b5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.459248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df10ec-6bd6-4cdd-8036-921b36663006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.459879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df10ec-6bd6-4cdd-8036-921b36663006 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.460166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df10ec-6bd6-4cdd-8036-921b36663006 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.460429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df10ec-6bd6-4cdd-8036-921b36663006 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.471522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df10ec-6bd6-4cdd-8036-921b36663006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-62df10ec-6bd6-4cdd-8036-921b36663006 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:07.476898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:07.477991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:07.478822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 275/564] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:07.479504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9959-f23d-4b61-b0ce-c4857f0c63df None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.479822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9959-f23d-4b61-b0ce-c4857f0c63df None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.480689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9959-f23d-4b61-b0ce-c4857f0c63df None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.485220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 276/565] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:07.485220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9959-f23d-4b61-b0ce-c4857f0c63df None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.505858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.529440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40fcac-9555-466a-823b-c9116b32ae97 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.563041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.563668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.563944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.564210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.571314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.572759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:07.583653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:07.590006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:07.591389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:07.592059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9959-f23d-4b61-b0ce-c4857f0c63df None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.592146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 290/566] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:07.592146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.595694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.624980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000bfe2-4064-4458-a3e1-ccd1c15c0f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.625608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000bfe2-4064-4458-a3e1-ccd1c15c0f2a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.625884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000bfe2-4064-4458-a3e1-ccd1c15c0f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.626153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000bfe2-4064-4458-a3e1-ccd1c15c0f2a None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.626852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000bfe2-4064-4458-a3e1-ccd1c15c0f2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:07.627135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000bfe2-4064-4458-a3e1-ccd1c15c0f2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.628552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000bfe2-4064-4458-a3e1-ccd1c15c0f2a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.640052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 277/567] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:07.641227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1b2c-91b8-4418-99e9-497279a05d4b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.641512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1b2c-91b8-4418-99e9-497279a05d4b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.641787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1b2c-91b8-4418-99e9-497279a05d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.659422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4f4e1b2c-91b8-4418-99e9-497279a05d4b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:07.660616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4f4e1b2c-91b8-4418-99e9-497279a05d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:07.692056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80dfc6-b7c5-4c38-baaf-1312ef13fd67 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.725507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 278/568] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:07.726251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1b2c-91b8-4418-99e9-497279a05d4b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.737058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.737943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.738561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.738838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.739104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.739764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:07.740065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.741463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.750259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 291/569] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:07.751134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.824441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:07.836316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1b2c-91b8-4418-99e9-497279a05d4b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.864701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f048ae-a44a-41b0-a759-cc1de1aad94c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:07.879481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.880796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.881410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.881822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.894764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:07.899877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:07.900482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:07.900746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:07.901884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:07.903023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:07.903793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:07.903793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:07.903793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:07.903793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:07.903793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:07.905483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 279/570] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:07.907235 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.922234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 292/571] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:07.922915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:07.993847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.024747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59243401-89c7-45e5-97b8-89c284373ce9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.027936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75b1f5-2ce7-4c02-a2e8-3f77d0e3ba0a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.053797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.059945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.060558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.060835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.061131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.061849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ed6b146dd405411db127d9668822cbc4) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:08.062160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.062869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.063514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.063673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.063797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.064073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.069269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 280/572] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/role_assignments?user.id=ed6b146dd405411db127d9668822cbc4&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:08.069895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.075340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.076820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:08.097692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:08.099000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:08.100000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:08.100000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:08.100000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:08.100000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 293/573] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:08.100000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.198573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eace5-48aa-49da-90bd-a8cbfe7ee67c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.210309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fb5ff-5f6e-492f-a7b2-7d687040f29d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.238822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.239442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.239726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.239996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.240693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:08.241083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.242451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.243950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.251519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.252354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.252463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 281/574] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:08.252872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.253317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.257907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.271451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.273437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:08.288679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:08.289808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:08.294177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:08.294177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:08.294177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:08.294177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 294/575] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:08.294177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.325024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.369470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5750df-3c2b-4be9-8140-d8abad14dc25 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.406337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6598dea-aa28-44a0-b9ce-8d69e930bb9c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.406750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.407389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.407670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.407939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.419540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:08.424275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:08.425230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:08.426074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 282/576] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:08.426765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.447727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.448334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.449154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.449427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.450055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:08.450350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.451700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.463515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 295/577] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:08.464275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.492542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.545094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c6c8-ae64-4119-a076-5b339344bb05 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.558429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.569014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6df38-fd21-4805-a6a3-f4782ebc736f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.581406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.582035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.582337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.582611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.594631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.596098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.607812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.608424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.608701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.608969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.609632 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:08.609935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.611279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:08.611900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:08.612806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:08.613789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:08.613789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:08.613789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:08.617667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 283/578] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:08.618293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.625913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 296/579] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:08.626762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.722459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f4d-19a6-4188-ae03-c6ee9d80306a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.733302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.741233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e736f3d-67f3-4f3e-82c5-771bc074ad06 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.758140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.759961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.759961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.759961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.760202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:08.760478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.762193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.771061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 284/580] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:08.772168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.782989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.783717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.784001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.784275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.793224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.794662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:08.806784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:08.807712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:08.809636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 297/581] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:08.813771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.826561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:08.884900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1543c0-afad-4ea7-b002-29bab774e620 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.922368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.923074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.923358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.923627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.924266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:08.924566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.925133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc8e0d-bac3-4a27-b50e-5614b44a2d4b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:08.925961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.939040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 285/582] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:08.939912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.966618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:08.967252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:08.967534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:08.967801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:08.975222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:08.976660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:08.988531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:08.989448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:08.990330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 298/583] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:08.990814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:08.997534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.065810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.075630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d58e58-866a-4407-90c1-a71507033377 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.097858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f183d7-848b-4e8f-a8b2-aa822612b9b8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.110914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.111614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.111958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.112294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.123984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.125441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.135400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.136107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.136458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.136798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.137616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:09.137991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:09.139043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:09.140119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:09.145836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:09.145836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:09.145836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:09.146045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.146130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 286/584] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:09.146130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.164078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 299/585] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Sep 9 21:19:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:09.164755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.240872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.263514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2ea7a-b860-4a30-829a-27cb2142b529 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.267708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7787706-54eb-4024-a340-eefa5ee6873f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.294530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.302370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.302979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.303255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.303525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.304600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:09.304600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.305669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.305931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.306304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.306585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.306858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.316413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.323026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.323148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 300/586] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:09.323148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:09.334547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:09.335498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 287/587] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:09.336423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.429780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba334a89-330f-4518-be89-db889ae29ae3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.445715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe721-f5ea-4df0-8190-4dbde28460cb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.465459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.466064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.466339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.466608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.467240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:09.467544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.468887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.480615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 301/588] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:09.481395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.489861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.490753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.491545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.492015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.503940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.505541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.507567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:09.521244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:09.522428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:09.523604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:09.523604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:09.523604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:09.524372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 288/589] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:09.525206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.538498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.594618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9c435-6a8c-43d1-8164-63260c04c98f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.630036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab96f66-dbd3-4147-bb6f-92002b4a8b19 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.630464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.631185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.631682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.632018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/97eb6832e7d246d6b6f1813763ac8a74/roles/94b322ecf59e4767888638fc0e33204e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.651535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=97eb6832e7d246d6b6f1813763ac8a74, role_id=94b322ecf59e4767888638fc0e33204e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.652673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.665294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.665975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.666325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.666668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.667649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:09.668222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.669742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.687477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 289/590] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:09.688400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.717827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 302/591] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:09 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/97eb6832e7d246d6b6f1813763ac8a74/roles/94b322ecf59e4767888638fc0e33204e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:19:09.718744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.759828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.843507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:09.847393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93ab74-227e-49b0-b1e4-051588ccc255 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.851947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d173f-8070-41b6-87ab-0b1c8394d859 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:09.903179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.903953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.904238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:09.904405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.904772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.904877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:09.905169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:09.905443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:09.911723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:09.911723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.911723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.914259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:09.916406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:09.923040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 303/592] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:09.923904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:09.936416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:09.941558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 290/593] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:09.942571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.035693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de57d-403e-4154-80b0-32d94c42b010 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.073649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.074608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.074993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.075371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.086854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.088495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:10.103873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:10.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:10.107516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:10.107516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:10.107516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:10.109273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 304/594] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:10.113264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.119805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45930614-5a7a-43ac-8e7b-db65e81b6f73 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.129550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:10.139118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:10.175675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.178256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.178987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.179558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.190303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.192905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:10.213379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:10.214896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:10.215775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:10.218229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 291/595] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:10.219251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.237837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283993a-2774-4cdc-99ae-da379d8fb777 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.283544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.284188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.284468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.284749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.285528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:10.285839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.287262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.311148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 305/596] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Sep 9 21:19:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:10.311148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.336582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc725-0963-408e-aedc-3cbc1049183f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.375325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bb0af-ae75-4ecc-b6bd-b7db275419d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.375887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb0af-ae75-4ecc-b6bd-b7db275419d9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.376150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb0af-ae75-4ecc-b6bd-b7db275419d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.376419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bb0af-ae75-4ecc-b6bd-b7db275419d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.377064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bb0af-ae75-4ecc-b6bd-b7db275419d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:10.377374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bb0af-ae75-4ecc-b6bd-b7db275419d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.378736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bb0af-ae75-4ecc-b6bd-b7db275419d9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.385312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:10.395588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 292/597] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:10.395588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5396510-3df9-4734-aae8-094173e40ce1 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.395588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5396510-3df9-4734-aae8-094173e40ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.395588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5396510-3df9-4734-aae8-094173e40ce1 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.395588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 293/598] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:10.395588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5396510-3df9-4734-aae8-094173e40ce1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.426328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf1a6-d662-4909-971d-658ba5477389 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.430841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:10.462293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.462910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.463194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.463473 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.464197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:10.464503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.465951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.483096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 306/599] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:10.483096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.516767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5396510-3df9-4734-aae8-094173e40ce1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.551331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0942d7-d865-4854-855c-79e7a2bbea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.551961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0942d7-d865-4854-855c-79e7a2bbea90 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.552243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0942d7-d865-4854-855c-79e7a2bbea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.552515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0942d7-d865-4854-855c-79e7a2bbea90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.563211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0942d7-d865-4854-855c-79e7a2bbea90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.564670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0942d7-d865-4854-855c-79e7a2bbea90 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2e0942d7-d865-4854-855c-79e7a2bbea90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:10.579884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:10.580987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:10.582096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:10.582096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:10.582096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:10.582096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 294/600] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:10.582096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75fa78-0b0f-42f8-8a8e-751142cd032a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.582413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75fa78-0b0f-42f8-8a8e-751142cd032a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.582731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75fa78-0b0f-42f8-8a8e-751142cd032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.596861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485ff12-52f8-4678-ae82-2e65584fd7c4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.601192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8c75fa78-0b0f-42f8-8a8e-751142cd032a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:10.602436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8c75fa78-0b0f-42f8-8a8e-751142cd032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:10.625956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:10.635153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.642404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.642404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.642404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.644823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.646408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:10.660444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:10.661494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:10.662355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 307/601] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:10.662828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.678700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 295/602] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:10.679841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75fa78-0b0f-42f8-8a8e-751142cd032a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.702918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:10.798199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75fa78-0b0f-42f8-8a8e-751142cd032a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.799937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31b6d-f115-4637-997f-d16d094c1f25 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:10.837748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.838778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.839464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.840122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.841059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:10.841651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.843273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.849140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:10.849884 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:10.850229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:10.850573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/1852c201959444ca8066470206aa6167/roles/94b322ecf59e4767888638fc0e33204e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:10.866874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 296/603] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:10.868056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:10.882525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=1852c201959444ca8066470206aa6167, role_id=94b322ecf59e4767888638fc0e33204e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:10.884671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:10.948172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:10.971977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba35f5-bd5f-4e01-af51-4ebf538e3442 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.005201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.005809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.006083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.006347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.007026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:11.007323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:11.008749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:11.020664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 297/604] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:11.021261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:11.116521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775c27e-3a5e-49cd-b588-aa9a87b39389 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.137148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 308/605] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:10 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/1852c201959444ca8066470206aa6167/roles/94b322ecf59e4767888638fc0e33204e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:19:11.137148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:11.170482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.171627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.171987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.172595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.175945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:11.184822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:11.186423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:11.187883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:11.203308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:11.204603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:11.205773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:11.209200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 298/606] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:11.210258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:11.290828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae936-87f8-455e-967d-47a389fe4153 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.338484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.339721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dff8c-7b18-44b8-ae01-bd59825e3bd5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.339885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.340157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.340434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.352815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:11.358206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:11.359133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:11.359957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 309/607] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:11.360660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:11.383444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.384100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.384372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.384638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/3d284f9dd17546208bc48aa269c56fe8/roles/94b322ecf59e4767888638fc0e33204e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.402153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=3d284f9dd17546208bc48aa269c56fe8, role_id=94b322ecf59e4767888638fc0e33204e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:11.403662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:11.467013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:11.471546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7d4af-2126-49fd-943d-25bee1af13eb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.505065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 299/608] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:11 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/3d284f9dd17546208bc48aa269c56fe8/roles/94b322ecf59e4767888638fc0e33204e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:19:11.505065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:11.538870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.539586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.541266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.541617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.542613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:11.544037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:11.549330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:11.575107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 310/609] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:11.583153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:11.606547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:11.718542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198389c-daed-4539-9418-8c72a8411556 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.768871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1c94e-89a8-4d47-9219-bee1dafea2a1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.771156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.772679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.772963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.773279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.773952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:11.774261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:11.775644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:11.788694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 300/610] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:11.796461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:11.818931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7565-1228-463d-91bf-b9d7fb7707a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.819668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7565-1228-463d-91bf-b9d7fb7707a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.819949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7565-1228-463d-91bf-b9d7fb7707a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.820330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7565-1228-463d-91bf-b9d7fb7707a1 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/cf39db40dace49cbba29c0596cbe76bb/roles/94b322ecf59e4767888638fc0e33204e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.837380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7565-1228-463d-91bf-b9d7fb7707a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=cf39db40dace49cbba29c0596cbe76bb, role_id=94b322ecf59e4767888638fc0e33204e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:11.838889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7565-1228-463d-91bf-b9d7fb7707a1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:11.926042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539b56-db8f-413e-b834-e44600841582 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:11.928278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 311/611] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:11 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/cf39db40dace49cbba29c0596cbe76bb/roles/94b322ecf59e4767888638fc0e33204e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:19:11.936050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:11.977223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7cb7b-51e4-4310-b694-0eaa2f979b34 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.977420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7cb7b-51e4-4310-b694-0eaa2f979b34 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.977688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7cb7b-51e4-4310-b694-0eaa2f979b34 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.978940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:11.979315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 312/612] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:11.980429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.980960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.981564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:11.984957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e899c-9b74-4d48-8238-2f88adee4d28 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:11.985204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e899c-9b74-4d48-8238-2f88adee4d28 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:11.985486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e899c-9b74-4d48-8238-2f88adee4d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:12.006251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:12.011032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:12.015087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cd3e899c-9b74-4d48-8238-2f88adee4d28 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:12.016312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cd3e899c-9b74-4d48-8238-2f88adee4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:12.018887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:12.036952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:12.040465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:12.041429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:12.041429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:12.041429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:12.041429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 301/613] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:12.044465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:12.167107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 313/614] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:19:12.217115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddd92-403d-4a56-8572-2aa488dade7e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:12.254379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:12.254913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:12.255192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:12.255462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:12.256103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:12.256403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:12.257819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:12.271734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 302/615] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:12.276952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e899c-9b74-4d48-8238-2f88adee4d28 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:12.400998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e899c-9b74-4d48-8238-2f88adee4d28 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:12.445803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:12.446447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:12.446728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:12.447000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:12.455314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:12.456768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:12.466194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:12.469920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:12.475175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:12.476114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:12.477499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 314/616] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:12.483059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:12.498281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:12.653058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766f36e-d8e6-4c70-b666-a7ac2b7b52ff None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:12.668869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c43f-631f-40b9-b5b5-72cb220f3fe8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:12.708654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:12.709563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:12.709989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:12.710431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:12.711302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:12.711772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:12.713350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:12.731624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 315/617] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Sep 9 21:19:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:12.737655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:12.753735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:12.754569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:12.754851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:12.755122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:12.778036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:12.792419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:12.793623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:12.794654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 303/618] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:12.802284 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:12.805391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:12.851762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbef62f-d859-416a-ba65-f0d59e0c8b2c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:12.889193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:12.890141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:12.890691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:12.891126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:12.902780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:12.904613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:12.922095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:12.923331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:12.924456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:12.924456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:12.924456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:12.926179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 316/619] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:12.931821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:13.015378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:13.037502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea31ba-6e0d-41cf-84f6-ddb4ab9d7cdd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.048206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:13.071249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734044c5-35f3-4191-8f2a-b9cb4afd7f01 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.074542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.075358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.075788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.076207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.077002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:13.077509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.079027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:13.097396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 317/620] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:13.098828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:13.169818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.170364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.170648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.170925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.171613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:13.171889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.173418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:13.192286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 304/621] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:13.208030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6018-f9a3-4aae-b7f1-222bf3f6685d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.210031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:13.245899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.246983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.247542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.248016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.255950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.257833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:13.270543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:13.271479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:13.272404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:13.274753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 318/622] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:13.281345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:13.312166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:13.391600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813b838-4267-4af8-8f07-5a57307cd490 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.433864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee47a-0959-444f-ae33-6e2a38a03774 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.438912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.439522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.439797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.440065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.440751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:13.441066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.442629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:13.467139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 319/623] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:13.473926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:13.487315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.487943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.488220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.488486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.500877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:13.504309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.505803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:13.523563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:13.524548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:13.525479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:13.525479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:13.525479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:13.525479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 305/624] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:13.533992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:13.633983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:13.659265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f2987-7a92-4cda-8942-1f24bf00eb78 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.710117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f7e8-7258-49bb-a71c-6908061ce63f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.734827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe1b5-e540-4e61-9aca-891cf3c0857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.735501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1b5-e540-4e61-9aca-891cf3c0857c None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.735776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1b5-e540-4e61-9aca-891cf3c0857c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.736046 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1b5-e540-4e61-9aca-891cf3c0857c None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ed6b146dd405411db127d9668822cbc4/roles/94b322ecf59e4767888638fc0e33204e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.762408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe1b5-e540-4e61-9aca-891cf3c0857c None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=ed6b146dd405411db127d9668822cbc4, role_id=94b322ecf59e4767888638fc0e33204e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.763847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe1b5-e540-4e61-9aca-891cf3c0857c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:13.773826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.774435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.774714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.774983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.775624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:13.775925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.777551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:13.791036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 306/625] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:13.797237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:13.830643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 320/626] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:13 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ed6b146dd405411db127d9668822cbc4/roles/94b322ecf59e4767888638fc0e33204e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:19:13.837204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb5ec9-0159-48ae-a2b2-8c7f5fc14544 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.837598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb5ec9-0159-48ae-a2b2-8c7f5fc14544 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.837989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb5ec9-0159-48ae-a2b2-8c7f5fc14544 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.842146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 321/627] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:13.851068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf2eb6-0882-4805-8109-fb846c409da0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.851453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf2eb6-0882-4805-8109-fb846c409da0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.851734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf2eb6-0882-4805-8109-fb846c409da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.870942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:13.898325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-15bf2eb6-0882-4805-8109-fb846c409da0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:13.899857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-15bf2eb6-0882-4805-8109-fb846c409da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:13.929496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd71f21-dbf9-4e92-9ecd-a4f51ad12c90 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:13.971524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:13.972213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:13.972563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:13.973345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:13.983373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:13.986254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:14.003382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:14.004710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:14.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:14.007223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 307/628] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:19:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:14.018347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:14.128691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 322/629] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:14.133980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa0de-5671-4130-a3d1-5c9139ff7ae2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.134451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa0de-5671-4130-a3d1-5c9139ff7ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.134731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa0de-5671-4130-a3d1-5c9139ff7ae2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.136952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 323/630] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:14.143991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e14b5-4dac-41f4-959d-82d48c122563 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:14.148307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063073-dd99-4409-be65-8b50611f1e89 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.148606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063073-dd99-4409-be65-8b50611f1e89 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.148882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063073-dd99-4409-be65-8b50611f1e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.159193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:14.184088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:14.184842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.185306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.185645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.186479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:14.186885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:14.188409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:14.198117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0c063073-dd99-4409-be65-8b50611f1e89 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:14.200105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0c063073-dd99-4409-be65-8b50611f1e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:14.214710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 308/631] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:19:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:14.219525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:14.280127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:14.285382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 324/632] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:14.410204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327591e-0204-42a7-92bf-d23369dccecb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:14.450199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:14.450821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.451073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.451343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.463938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063073-dd99-4409-be65-8b50611f1e89 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:14.494475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:14.535989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:14.540158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:14.652813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063073-dd99-4409-be65-8b50611f1e89 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:14.696465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767f70c-50ac-42a7-8e5f-53593e3d5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:14.697513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f70c-50ac-42a7-8e5f-53593e3d5d30 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.697863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f70c-50ac-42a7-8e5f-53593e3d5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.698763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f70c-50ac-42a7-8e5f-53593e3d5d30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.710471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767f70c-50ac-42a7-8e5f-53593e3d5d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2767f70c-50ac-42a7-8e5f-53593e3d5d30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:14.716958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:14.717946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:14.718779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:14.721442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 325/633] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:14.723020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961a69-63df-43ba-8ce0-437cf82ef09d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.723449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961a69-63df-43ba-8ce0-437cf82ef09d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.723852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961a69-63df-43ba-8ce0-437cf82ef09d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.724204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 309/634] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:19:14.725057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:14.725554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 326/635] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:14.731285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d9a4-b94a-4e28-b525-3e72a2835707 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.731568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d9a4-b94a-4e28-b525-3e72a2835707 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.731839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d9a4-b94a-4e28-b525-3e72a2835707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.752500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-23d7d9a4-b94a-4e28-b525-3e72a2835707 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:14.753727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-23d7d9a4-b94a-4e28-b525-3e72a2835707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:14.807438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:14.812457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:14.836569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 327/636] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:14.836569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d9a4-b94a-4e28-b525-3e72a2835707 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:14.859483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b33be-e5dd-4992-9515-b577f7c065e7 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:14.904748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:14.905647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.905992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.906793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:14.921710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:14.928560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:14.929546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:14.930384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 310/637] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:14.931067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:14.952696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d9a4-b94a-4e28-b525-3e72a2835707 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:14.998421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:14.999326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:14.999606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:14.999904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.014678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.016995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:15.036089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:15.037903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:15.039127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:15.039127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:15.039127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:15.039127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 328/638] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:15.039127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.050341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21adb6-fb14-4328-9664-99612e9ce6c5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.084927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.091764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.092592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.092967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.093328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.098006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:15.098006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.098006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.098351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.105604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 311/639] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:15.106686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.168708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6379b3f-48cf-4dcc-8c1d-499b4fd6257b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.206975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.207850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.208290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.208712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8274-1abc-431e-ac83-a10362a05c87 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.208873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.209798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:15.210261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.211607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.221591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 329/640] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:15.222437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.248551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.249213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.249493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.249762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.250396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:15.250696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.252057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.264274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 312/641] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:15.264897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.322381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.342904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07ede-91ba-4902-97fa-c410dab869b8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.344527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.372335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1367e-55a1-44cc-8c38-20a296049e51 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.380926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.381596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.381873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.382550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.395192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.396617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.408550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.409213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.409495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.409778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:15.412024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:15.412960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:15.413870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:15.413870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:15.413870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:15.418325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 330/642] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:15.419017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.423582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:15.428381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:15.429588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 313/643] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:15.430899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.527403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4928d3d-dfe2-4ffe-be93-aa7457a1534c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.532096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6e21-e93e-4c06-b010-463c5423aa03 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.547192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.563921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.564554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.564835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.565141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.569965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.570810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.571272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.571727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.575917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.577389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.579757 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.581590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:15.592247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:15.593389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:15.594461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:15.594461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:15.594461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:15.594635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:15.595425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:15.596285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 314/644] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:15.598264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.602522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 331/645] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:15.603390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.612972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.707261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b8311-b14c-4e62-8bbe-599e6a61d8ef None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.709389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd083da-308c-4cf2-a981-75bc9c38a20f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.748616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.749245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.749523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.749656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.749858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.750254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.750426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:15.750522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.750707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.750800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.751417 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:15.751721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.752060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.753096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.769954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 332/646] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:15.769954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.770234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 315/647] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:15.770234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.804837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.842140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:15.877753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cad527-cd4b-43cc-a998-8e1f4496add0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.889791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7429f-443a-4bce-9a0c-71c26ff3c3f5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:15.912142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.912775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.913206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.913341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.913969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:15.914266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.915629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.927395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:15.928015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:15.928297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:15.928573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:15.928861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 316/648] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:15.929760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:15.933620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:15.933947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:15.935402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:15.949726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 333/649] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:15.950535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.031224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.039725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb01c-cfd2-4e6c-8d0d-e99796c3d85c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.062013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c9b0-a82e-4776-b0d7-6e49b20b4c04 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.076623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.077403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.077694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.077968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.085220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.086688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.090796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.099186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:16.105825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:16.106886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:16.108020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:16.108669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.108669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.108669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.108889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 317/650] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:16.108889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.123130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.124601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:16.141952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:16.142978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:16.143876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:16.143876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:16.143876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:16.143876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 334/651] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:16.144112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.231058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33cbd3-5479-416e-a071-de6660db0f92 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.260591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0853a6-10ce-46d8-867f-27d57fece3f7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.264977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.265628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.265901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.266168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.274444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.275884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:16.286722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:16.287879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 318/652] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:16.289146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.298422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.299020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.299294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.299561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.300277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=97eb6832e7d246d6b6f1813763ac8a74) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:16.300581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.302022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.304186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.308604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 335/653] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/role_assignments?user.id=97eb6832e7d246d6b6f1813763ac8a74&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:16.309330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.375335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.402333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40151e-d959-4c1d-91bd-d6718a98732e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.433822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cabe-7ea9-4453-a55f-b5812f204ec0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.440075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc3fca-a6b4-47d8-b41d-5fd0674ab98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.440694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc3fca-a6b4-47d8-b41d-5fd0674ab98a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.440973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc3fca-a6b4-47d8-b41d-5fd0674ab98a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.441294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc3fca-a6b4-47d8-b41d-5fd0674ab98a None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.442153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc3fca-a6b4-47d8-b41d-5fd0674ab98a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:16.442462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc3fca-a6b4-47d8-b41d-5fd0674ab98a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.443948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc3fca-a6b4-47d8-b41d-5fd0674ab98a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.468989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 319/654] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:16.468989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d09a-6097-478f-91a7-60a9e470a433 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.468989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d09a-6097-478f-91a7-60a9e470a433 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.468989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d09a-6097-478f-91a7-60a9e470a433 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.468989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 320/655] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:16.469747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5d09a-6097-478f-91a7-60a9e470a433 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.479837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.480587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.480826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.481012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.481680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:16.481982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.483345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.498606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 336/656] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:16.499367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.560396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.594858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5d09a-6097-478f-91a7-60a9e470a433 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.617061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d20eaa-4104-4432-9521-c703e69ac1d6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.621339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.632834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a9d4b-ec4e-4898-9faa-f98e4fe910a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.632834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9d4b-ec4e-4898-9faa-f98e4fe910a2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.632834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9d4b-ec4e-4898-9faa-f98e4fe910a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.633262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9d4b-ec4e-4898-9faa-f98e4fe910a2 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.633700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a9d4b-ec4e-4898-9faa-f98e4fe910a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:16.634006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a9d4b-ec4e-4898-9faa-f98e4fe910a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.635436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a9d4b-ec4e-4898-9faa-f98e4fe910a2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.654637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 321/657] 10.222.0.60 () {56 vars in 1137 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:16.655862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981cd5-5a37-430b-a3aa-7151d5ccc50a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.656148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981cd5-5a37-430b-a3aa-7151d5ccc50a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.656422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981cd5-5a37-430b-a3aa-7151d5ccc50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.659925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.660567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.660849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.661196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.674295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1f981cd5-5a37-430b-a3aa-7151d5ccc50a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:16.675493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1f981cd5-5a37-430b-a3aa-7151d5ccc50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:16.735073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.736532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.749580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 322/658] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:16.749580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981cd5-5a37-430b-a3aa-7151d5ccc50a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.807517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.857074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981cd5-5a37-430b-a3aa-7151d5ccc50a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:16.858300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 337/659] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:16.859358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.863437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:16.912375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:16.913313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:16.913595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:16.913868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:16.923611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:16.925399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:16.938369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:16.939310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 21:19:16.940231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:16.942770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 323/660] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:16.943808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:16.990200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714986-8789-46d9-b10b-5cc83d916d0f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.039150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.039777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.040061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.040334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.050898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74191b9-7152-46ab-890e-5972b78e6b2b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.069624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.087411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.088051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.088330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.088624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.100001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.101900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.114897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.116554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:17.116714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:17.117880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:17.118936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:17.118936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:17.118936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:17.122830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 324/661] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:17.123615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.123959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.231782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b792b-c12a-484e-9957-d5840af400d9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.232769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 338/662] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:17.237827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.267849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.268478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.268766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.269068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.269814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:17.270129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.271630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.290984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 325/663] 10.222.0.60 () {56 vars in 1139 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:17.291864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.321012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.351399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2da19e-a8ef-48a8-a58d-9e9a70977594 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.355520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.389680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.390787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.391081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.391362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.394520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794dff9-7bef-4326-b7bb-4e7320c233ef None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.403377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:17.408313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:17.409280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:17.410137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:17.413166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 339/664] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:17.414190 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.435920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.436528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.436808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.437103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.437765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:17.438043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.439407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.456215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 326/665] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:17.456215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.527595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388e08-8554-4b15-a33b-d9e83c88cb32 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.551635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.564358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7ad71-ec03-425d-89f0-d733c367245c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.565444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.566307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.567357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.567640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.580584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.582099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.600436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:17.600748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:17.601674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:17.602589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:17.602589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:17.602589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:17.602758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.602758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.602758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.602946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 340/666] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:17.603013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.625821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.675567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.676997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.714629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50e3c-a137-4edc-8b60-12210f2b469f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.753488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.754092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.754370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.754638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.755292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:17.755591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.756937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.767739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 341/667] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:17.768554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.773432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.786798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 327/668] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:17.787531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.864467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:17.887124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f171558-982e-477b-8c6a-e4aac7338d09 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.897421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c7a0d-febc-44d2-9e0a-b78c9ee75ad2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:17.922663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1db9-2309-463b-af21-27855752a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.923292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1db9-2309-463b-af21-27855752a05a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.923568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1db9-2309-463b-af21-27855752a05a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.923836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1db9-2309-463b-af21-27855752a05a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.930836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a1db9-2309-463b-af21-27855752a05a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.931852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:17.932263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a1db9-2309-463b-af21-27855752a05a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.932969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:17.933269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:17.933550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:17.934266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:17.934663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:17.936021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-335a1db9-2309-463b-af21-27855752a05a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:17.944175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:17.945101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:17.946024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 342/669] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:17.947484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1db9-2309-463b-af21-27855752a05a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:17.952922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 328/670] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:17.954126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.006745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.056428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1db9-2309-463b-af21-27855752a05a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.060597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9249d20-d191-4bf7-bd83-0a65bb7b82c4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.091846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.092486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.092749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.093019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.096354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.097211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.097888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.098308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.100548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.104880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.106339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.111397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.113075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:18.120369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:18.121541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:18.122429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:18.122429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:18.122429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:18.122429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 343/671] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:18.122725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:18.133000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:18.134293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:18.135457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:18.135457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:18.135457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:18.137461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 329/672] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:18.138413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.245045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.247552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb34320-6d03-4ffc-82d9-3008961a9c72 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.247904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9990bb5-950d-4cdb-98f7-8ea481ac8a57 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.283646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.284380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.284770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.284988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.285187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.285273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.285346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.285546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.286224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:18.286526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.287940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.292645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.294106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.305697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 344/673] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:18.305697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:18.305935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:18.306791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 330/674] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:18.307968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.363870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.412604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c95f4-5787-4bec-b47e-706a05c78d90 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.417774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08672-3db1-4108-91e8-d679ffc70e1c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.449062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.449794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.450073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.450344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.451012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:18.451533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.452739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.457024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.457682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.457959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.458229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.458883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:18.459184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.460571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.467260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 331/675] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:18.468161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.481265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 345/676] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:18.482789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.493675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.579014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815de4f-9f9d-4ecf-9167-11ff1e6a3074 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.586536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a68a8-5f72-4634-b370-4027eb6129ee None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.597875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.615143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.615742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.616015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.616287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.617000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=1852c201959444ca8066470206aa6167) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:18.617337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.618759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.621225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.621821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.622098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.622367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.623043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:18.623346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.624735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.624987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 332/677] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/role_assignments?user.id=1852c201959444ca8066470206aa6167&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:18.625882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.638591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 346/678] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:18.644321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.720297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.736761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a80432-7bdc-484e-aa22-aec7d974cf45 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.762639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a8947-863e-4ea7-890c-9daf279edf4a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.775449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892178f2-dc50-4ca0-b1db-1025f27d3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.776139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892178f2-dc50-4ca0-b1db-1025f27d3ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.776419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892178f2-dc50-4ca0-b1db-1025f27d3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.776698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892178f2-dc50-4ca0-b1db-1025f27d3ae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.784348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892178f2-dc50-4ca0-b1db-1025f27d3ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.785846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892178f2-dc50-4ca0-b1db-1025f27d3ae3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-892178f2-dc50-4ca0-b1db-1025f27d3ae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:18.798018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:18.798949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:18.799827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:18.800252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 333/679] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:18.801838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914122a-d54d-4472-959d-d82ee8dd9ec2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.801838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914122a-d54d-4472-959d-d82ee8dd9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.802012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.802106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914122a-d54d-4472-959d-d82ee8dd9ec2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.802399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.802680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.802953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.807805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 334/680] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:18.807805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914122a-d54d-4472-959d-d82ee8dd9ec2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.816455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.817921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:18.829965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:18.830931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 347/681] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:18.831942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:18.872962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:18.920484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914122a-d54d-4472-959d-d82ee8dd9ec2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.945506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e160-674b-4d81-964b-d5ea54c05f1d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:18.960739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02f97f-7696-48e3-bb1f-ade74ea4628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.961648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f97f-7696-48e3-bb1f-ade74ea4628c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.961973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f97f-7696-48e3-bb1f-ade74ea4628c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.962246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f97f-7696-48e3-bb1f-ade74ea4628c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.963137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02f97f-7696-48e3-bb1f-ade74ea4628c None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=3d284f9dd17546208bc48aa269c56fe8) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:18.963842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02f97f-7696-48e3-bb1f-ade74ea4628c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.965422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02f97f-7696-48e3-bb1f-ade74ea4628c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.974130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 335/682] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/role_assignments?user.id=3d284f9dd17546208bc48aa269c56fe8&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:18.975347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed6792-0072-4fb9-a10f-4cc32c8467a6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.975622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed6792-0072-4fb9-a10f-4cc32c8467a6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.975906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed6792-0072-4fb9-a10f-4cc32c8467a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.983037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:18.985624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:18.986259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:18.986733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:18.987675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:18.988187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:18.989900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:18.998741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c6ed6792-0072-4fb9-a10f-4cc32c8467a6 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:19.000018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c6ed6792-0072-4fb9-a10f-4cc32c8467a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:19.003939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:19.009132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 348/683] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:19.010426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:19.089084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 336/684] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:19.090380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed6792-0072-4fb9-a10f-4cc32c8467a6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:19.144219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:19.165684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400634-fc64-4667-9d6b-5ac068cd43f4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:19.216917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed6792-0072-4fb9-a10f-4cc32c8467a6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:19.220131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:19.220996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:19.221509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:19.222045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:19.223223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:19.223723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:19.225381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:19.248535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 349/685] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:19.253818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:19.260636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:19.261325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:19.261608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:19.261881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:19.262617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=cf39db40dace49cbba29c0596cbe76bb) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:19.262925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:19.264380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:19.272719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 337/686] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/role_assignments?user.id=cf39db40dace49cbba29c0596cbe76bb&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:19.378340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219af8-8cbb-428e-b661-c1b1d1dc84ec None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:19.417446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:19.418487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:19.419001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:19.419531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:19.437155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:19.440115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:19.442532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:19.511180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:19.512699 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:19.566720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed838-67f7-461b-8846-8f135c474223 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:19.606183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:19.606958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:19.607146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:19.607419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:19.618319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:19.624874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:19.626025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:19.627182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 338/687] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:19.631865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:19.650732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 350/688] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:19.657890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:19.699493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:19.722350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:19.743346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50badfc1-1a65-4738-b64d-eecc2010751d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:19.796149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e36c-85a7-4de8-a546-d16d3e9e1518 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:19.798996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:19.799610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:19.799886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:19.800150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:19.800809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:19.802137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:19.803526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:19.823954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 339/689] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:19.848706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:19.874210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:19.875079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:19.875365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:19.875642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:19.900308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:19.901974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:19.930300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:19.931280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:19.933638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:19.933638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:19.933638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:19.933638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 351/690] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:19.937732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:20.015921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4873-1198-44d7-8f6d-c98fbe32f265 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:20.041209 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:20.053124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:20.053798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:20.054222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:20.054501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:20.067249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:20.068762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:20.084373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:20.085385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:20.086760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:20.086760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:20.086760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:20.086760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 340/691] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:20.092000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:20.152662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:20.155745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acd5d1-1c50-485c-a9f8-88045ac4e392 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:20.301402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a302f72-da30-464c-bba1-50f19674ba6f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:20.373529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:20.374152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:20.374427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:20.374693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:20.375338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:20.375637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:20.377012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:20.390881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 341/692] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:20.391788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:20.392412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:20.392689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:20.392954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:20.393644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:20.393940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:20.395292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:20.406617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:20.412640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 352/693] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:20.419760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:20.489952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:20.605940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd80fa-f85b-4eb3-a3b7-010ffd93c099 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:20.611361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81065a87-2d03-4b55-b710-cc872ae9f364 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:20.671105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:20.672156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:20.672441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:20.673237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:20.676603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:20.677272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:20.677551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:20.677823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:20.689040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:20.690481 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:20.691900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:20.694330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:20.711548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:20.712480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:20.715807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 353/694] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:20.718718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:20.720826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:20.723475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:20.724714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:20.724861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 342/695] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:19:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:20.730093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:20.755252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:20.904606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59149d1f-22bf-4465-af83-8b537cd3b85a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:20.910587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:20.923982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588c55-5bb9-4336-a890-96593c1b90b0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:20.982833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:20.984467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:20.985128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:20.986158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:20.987212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:20.988231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:20.990025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:21.000387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:21.001274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.001731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.002200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.003212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:21.003705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:21.005424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:21.016245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 354/696] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:21.022155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:21.040236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 343/697] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:19:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:21.047650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:21.132161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:21.153118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da1599-2c23-4d56-95c6-779452f2c489 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:21.158761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f30dc-843a-4ca7-ab38-d5f16ea02c26 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:21.188896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:21.189550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.189965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.190331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.203651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0a2ef-63c4-4bf9-8535-03f79e852af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:21.204787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0a2ef-63c4-4bf9-8535-03f79e852af8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.205295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0a2ef-63c4-4bf9-8535-03f79e852af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.205736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0a2ef-63c4-4bf9-8535-03f79e852af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.207369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0a2ef-63c4-4bf9-8535-03f79e852af8 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ed6b146dd405411db127d9668822cbc4) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:21.207857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0a2ef-63c4-4bf9-8535-03f79e852af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:21.209977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0a2ef-63c4-4bf9-8535-03f79e852af8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:21.216742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:21.220144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 355/698] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:21 2022] GET /identity/v3/role_assignments?user.id=ed6b146dd405411db127d9668822cbc4&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:21.222621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41ee4-0e66-47fa-99e0-21cb84119da8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.223086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41ee4-0e66-47fa-99e0-21cb84119da8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.223784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41ee4-0e66-47fa-99e0-21cb84119da8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.229990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 356/699] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:21.233121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fee67d-e671-4f6d-9610-c98eb0787907 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.233515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fee67d-e671-4f6d-9610-c98eb0787907 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.233887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fee67d-e671-4f6d-9610-c98eb0787907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.256228 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-08fee67d-e671-4f6d-9610-c98eb0787907 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:21.261102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-08fee67d-e671-4f6d-9610-c98eb0787907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:21.299492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:21.300997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:21.410686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 357/700] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 21:19:21.457394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 344/701] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:19:21.463246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fee67d-e671-4f6d-9610-c98eb0787907 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:21.550804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:21.578720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fee67d-e671-4f6d-9610-c98eb0787907 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:21.615798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:21.616429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.616704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.617020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.628334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:21.629795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:21.646114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:21.647096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:21.648063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:21.648063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:21.648063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:21.648063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 358/702] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:21.653367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:21.712195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:21.756705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:21.775135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d53cc-b7cb-4b0d-9e95-b82b454bd865 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:21.814917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:21.815894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.815894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.816073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.816727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:21.817025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:21.818493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:21.833697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 345/703] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:21.839302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:21.905250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa35d8-4cbc-419a-8d6b-3181f1cc0c97 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:21.938628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:21.947512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad7960-555e-4095-9b08-5c2a09b490b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:21.948718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad7960-555e-4095-9b08-5c2a09b490b7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.948999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad7960-555e-4095-9b08-5c2a09b490b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.949296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad7960-555e-4095-9b08-5c2a09b490b7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.949884 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad7960-555e-4095-9b08-5c2a09b490b7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:21.951732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad7960-555e-4095-9b08-5c2a09b490b7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8dad7960-555e-4095-9b08-5c2a09b490b7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:21.965214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:21.966458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:21.967514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 359/704] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Sep 9 21:19:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:21.968482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df02f7-a8f9-40aa-bcf5-a9b7a53910bb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.968482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df02f7-a8f9-40aa-bcf5-a9b7a53910bb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.968482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df02f7-a8f9-40aa-bcf5-a9b7a53910bb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.973939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 360/705] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:21.974886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454072-dda7-46a9-90a1-494a2bdb2549 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:21.975179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454072-dda7-46a9-90a1-494a2bdb2549 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:21.975445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454072-dda7-46a9-90a1-494a2bdb2549 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:21.976905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 361/706] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:21.977615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab454072-dda7-46a9-90a1-494a2bdb2549 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:21.987374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9a70-5069-4535-ac70-eae3a31948e5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:22.001641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:22.022639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91798-bfe4-422f-859b-0e9a2d842615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:22.023693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91798-bfe4-422f-859b-0e9a2d842615 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.023974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91798-bfe4-422f-859b-0e9a2d842615 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.024243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91798-bfe4-422f-859b-0e9a2d842615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.032042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b91798-bfe4-422f-859b-0e9a2d842615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:22.034016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b91798-bfe4-422f-859b-0e9a2d842615 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-63b91798-bfe4-422f-859b-0e9a2d842615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:22.046476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:22.047450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:22.048382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:22.049589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 346/707] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:22.050369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ce2a-9433-4e68-80fd-e55ad769a9bc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.050645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ce2a-9433-4e68-80fd-e55ad769a9bc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.050912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ce2a-9433-4e68-80fd-e55ad769a9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.070355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e2d3ce2a-9433-4e68-80fd-e55ad769a9bc None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:22.071542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e2d3ce2a-9433-4e68-80fd-e55ad769a9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:22.096483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab454072-dda7-46a9-90a1-494a2bdb2549 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:22.137086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:22.138032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.138422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.138698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.139367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:22.139665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:22.148330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 347/708] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:22.148482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:22.148576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397d61f-1387-4a26-a637-fe70488cbb33 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.148576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397d61f-1387-4a26-a637-fe70488cbb33 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.148576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397d61f-1387-4a26-a637-fe70488cbb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.153160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 362/709] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Sep 9 21:19:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:22.154317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:22.174558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f397d61f-1387-4a26-a637-fe70488cbb33 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:22.175934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f397d61f-1387-4a26-a637-fe70488cbb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:22.217880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:22.254281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 348/710] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:22.255332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397d61f-1387-4a26-a637-fe70488cbb33 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:22.290656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0c0a1-2539-4bed-bdd7-40df5bdcdc9c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:22.317447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:22.355510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:22.356185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.356467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.356736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.357451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:22.357810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:22.359339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:22.384523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 363/711] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:22.387232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:22.442750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397d61f-1387-4a26-a637-fe70488cbb33 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:22.492596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:22.493274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.493582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.493952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.495333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:22.495741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:22.497628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:22.499844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea445e24-3561-4480-9aef-9f15e2b74e60 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:22.505060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 349/712] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Sep 9 21:19:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:22.506066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:22.538545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:22.552797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:22.552797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.552797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.552797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.553629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=97eb6832e7d246d6b6f1813763ac8a74) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:22.553824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:22.558026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:22.571977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 364/713] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:22 2022] GET /identity/v3/role_assignments?user.id=97eb6832e7d246d6b6f1813763ac8a74&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:22.599875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:22.671632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:22.678310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bf1e6-f78f-4da0-bb5a-dfe156b1de36 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:22.761325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b778d-0e32-4d64-b465-002907a06bad None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:22.769519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992df03-bef6-42cc-8867-124499097069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:22.770172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992df03-bef6-42cc-8867-124499097069 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.770448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992df03-bef6-42cc-8867-124499097069 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.770714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992df03-bef6-42cc-8867-124499097069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.787001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992df03-bef6-42cc-8867-124499097069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:22.788486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992df03-bef6-42cc-8867-124499097069 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6992df03-bef6-42cc-8867-124499097069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:22.807033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:22.808717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:22.809852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:22.809852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:22.809852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:22.810066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:22.810169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 350/714] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:22.810250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:22.810250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:22.810393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] PATH_INFO: `/v3/services/network` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:22.810870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:22.812235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:22.817140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992df03-bef6-42cc-8867-124499097069 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:22.823108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:22.824161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:22.824988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:22.825734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 365/715] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:22 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:22.831918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:22.889242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:23.000255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992df03-bef6-42cc-8867-124499097069 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:23.014384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2365e-1fe5-4608-979f-f9a1e7f59976 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:23.055387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:23.058064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:23.059198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:23.060306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:23.061352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:23.062999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:23.065423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:23.078342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:23.079301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:23.079803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:23.080279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:23.081131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] RBAC: Adding query filter params (name=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:23.081656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:23.083208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:23.095554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 366/716] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:23.098255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 351/717] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:23.099719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:23.100420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:23.117799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:23.236331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3585-a11a-4117-a9a0-bcd11912eb58 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:23.237005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a00018-7d6c-41e3-af02-9b6300eb6e60 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:23.251618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:23.278973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311e4e-ca2a-44fa-8bcb-58ea40f05467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:23.281046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311e4e-ca2a-44fa-8bcb-58ea40f05467 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:23.281538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311e4e-ca2a-44fa-8bcb-58ea40f05467 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:23.283247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311e4e-ca2a-44fa-8bcb-58ea40f05467 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:23.284107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311e4e-ca2a-44fa-8bcb-58ea40f05467 None admin] RBAC: Adding query filter params (type=network) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:23.284814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311e4e-ca2a-44fa-8bcb-58ea40f05467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:23.287087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311e4e-ca2a-44fa-8bcb-58ea40f05467 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:23.297334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 352/718] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:23.300907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b0d70-e6fc-4520-9166-3d724af03a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:23.301842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b0d70-e6fc-4520-9166-3d724af03a87 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:23.302349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b0d70-e6fc-4520-9166-3d724af03a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:23.302845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b0d70-e6fc-4520-9166-3d724af03a87 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:23.303738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b0d70-e6fc-4520-9166-3d724af03a87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:23.305500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b0d70-e6fc-4520-9166-3d724af03a87 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:23.425551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 367/719] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:19:23 2022] POST /identity/v3/users => generated 254 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:19:24.140353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb872be-789f-49d8-9dc1-55a174c78957 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:24.140840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb872be-789f-49d8-9dc1-55a174c78957 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:24.140840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb872be-789f-49d8-9dc1-55a174c78957 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:24.142443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 353/720] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:24.147516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73edea-5db0-4512-bc25-b53e230ca07d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:24.148338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73edea-5db0-4512-bc25-b53e230ca07d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:24.148808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73edea-5db0-4512-bc25-b53e230ca07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:24.174358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-af73edea-5db0-4512-bc25-b53e230ca07d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:24.175912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af73edea-5db0-4512-bc25-b53e230ca07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:24.263505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 368/721] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:24.596048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb872be-789f-49d8-9dc1-55a174c78957 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:24.687042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:24.723059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb872be-789f-49d8-9dc1-55a174c78957 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:24.767896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:24.768535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:24.768812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:24.769100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:24.783307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:24.788031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:24.788982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:24.789837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 354/722] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:24.797260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73edea-5db0-4512-bc25-b53e230ca07d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:24.939672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:24.950317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73edea-5db0-4512-bc25-b53e230ca07d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:24.988446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd34d4-fced-454f-80d1-57a7e2e6ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:24.989088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd34d4-fced-454f-80d1-57a7e2e6ed9e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:24.989381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd34d4-fced-454f-80d1-57a7e2e6ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:24.989648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd34d4-fced-454f-80d1-57a7e2e6ed9e None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:24.990307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd34d4-fced-454f-80d1-57a7e2e6ed9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:24.990606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd34d4-fced-454f-80d1-57a7e2e6ed9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:24.991947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd34d4-fced-454f-80d1-57a7e2e6ed9e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:25.000665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 369/723] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:25.006364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:25.138596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89c88-8dca-4d37-bd7e-9eddbbf983ab None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:25.185586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7c989-6f66-4323-a95f-e55caddc2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:25.186245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7c989-6f66-4323-a95f-e55caddc2792 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.186491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7c989-6f66-4323-a95f-e55caddc2792 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.186764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7c989-6f66-4323-a95f-e55caddc2792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.188799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:25.198873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7c989-6f66-4323-a95f-e55caddc2792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:25.200326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7c989-6f66-4323-a95f-e55caddc2792 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-60d7c989-6f66-4323-a95f-e55caddc2792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:25.215033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:25.215977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:25.216930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:25.216930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:25.216930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:25.216930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 355/724] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:25.218873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c276a-e3f7-47a8-9e4d-18aa14d1e759 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.219354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c276a-e3f7-47a8-9e4d-18aa14d1e759 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.219435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c276a-e3f7-47a8-9e4d-18aa14d1e759 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.220707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 370/725] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:25.228924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4f5b-3ed9-45ae-9d20-a9660842fac7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.228924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4f5b-3ed9-45ae-9d20-a9660842fac7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.228924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4f5b-3ed9-45ae-9d20-a9660842fac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.229980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c276a-e3f7-47a8-9e4d-18aa14d1e759 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:25.251156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ee0d4f5b-3ed9-45ae-9d20-a9660842fac7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:25.252370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ee0d4f5b-3ed9-45ae-9d20-a9660842fac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:25.353448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 356/726] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:25.355673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723edef-d17f-4ef8-b6f7-1c3b762d495d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.356118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723edef-d17f-4ef8-b6f7-1c3b762d495d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.356396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723edef-d17f-4ef8-b6f7-1c3b762d495d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.358071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 357/727] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:25.364106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65110cc-0374-432a-a526-e018b1db72c1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.364440 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65110cc-0374-432a-a526-e018b1db72c1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.364712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65110cc-0374-432a-a526-e018b1db72c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.375033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c276a-e3f7-47a8-9e4d-18aa14d1e759 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:25.402956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b65110cc-0374-432a-a526-e018b1db72c1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:25.404067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b65110cc-0374-432a-a526-e018b1db72c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:25.442350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:25.442954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.443229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.443498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.444139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:25.444439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:25.445831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:25.463800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 371/728] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:25.469685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:25.487443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:25.564929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 358/729] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:25.615002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c51ca-1506-4fa6-8eda-c75209a9d5ab None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:25.656681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:25.657300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.657581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.657857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.665420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:25.666987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:25.683762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:25.685958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:25.688147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 372/730] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:25.693084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65110cc-0374-432a-a526-e018b1db72c1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:25.702453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:25.757311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:25.818438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65110cc-0374-432a-a526-e018b1db72c1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:25.877433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:25.892599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ed632-1017-4fe7-9157-acbdc7e2237e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:25.893731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:25.894365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.894643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.894915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.895663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:25.895971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:25.897442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:25.927724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:25.928266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:25.928548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:25.928822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:25.929530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:25.930933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:25.935713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 359/731] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Sep 9 21:19:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:25.941460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.052383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989dd3-b5be-4df1-866e-43ed49cf53e6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:26.055007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.077066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 373/732] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:19:25 2022] POST /identity/v3/services => generated 251 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:26.077066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.109361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582528ca-7429-4383-a909-de919cfdd31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:26.110003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582528ca-7429-4383-a909-de919cfdd31c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.110267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582528ca-7429-4383-a909-de919cfdd31c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.112709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582528ca-7429-4383-a909-de919cfdd31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.200339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582528ca-7429-4383-a909-de919cfdd31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:26.202152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582528ca-7429-4383-a909-de919cfdd31c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:26.212061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702797c2-cca8-4f5b-b088-6f24b1edfd4e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:26.260061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e83e0-3f79-4c88-a43b-6a9dbd1af16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:26.262752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e83e0-3f79-4c88-a43b-6a9dbd1af16a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.263314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e83e0-3f79-4c88-a43b-6a9dbd1af16a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.263777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e83e0-3f79-4c88-a43b-6a9dbd1af16a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.266601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.282114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e83e0-3f79-4c88-a43b-6a9dbd1af16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f94e83e0-3f79-4c88-a43b-6a9dbd1af16a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:26.288490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:26.289546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:26.291060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 374/733] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:26.291809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8517fc-8d99-4f88-8330-7f7af6eb72a8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.291809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8517fc-8d99-4f88-8330-7f7af6eb72a8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.291936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8517fc-8d99-4f88-8330-7f7af6eb72a8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.297862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 375/734] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:26.297862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8517fc-8d99-4f88-8330-7f7af6eb72a8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.340144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.345533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 360/735] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:25 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 21:19:26.346719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc843c4-8ed0-428c-9c12-206c58d6c73c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.347009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc843c4-8ed0-428c-9c12-206c58d6c73c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.347540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc843c4-8ed0-428c-9c12-206c58d6c73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.376307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fbc843c4-8ed0-428c-9c12-206c58d6c73c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:26.377715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fbc843c4-8ed0-428c-9c12-206c58d6c73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:26.418118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8517fc-8d99-4f88-8330-7f7af6eb72a8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:26.456469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 361/736] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:26.457272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc843c4-8ed0-428c-9c12-206c58d6c73c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.465121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57e17b-b3d7-4c78-b1f3-233cd04eade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:26.466027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57e17b-b3d7-4c78-b1f3-233cd04eade0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.466519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57e17b-b3d7-4c78-b1f3-233cd04eade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.466991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57e17b-b3d7-4c78-b1f3-233cd04eade0 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.467925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57e17b-b3d7-4c78-b1f3-233cd04eade0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:26.468459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57e17b-b3d7-4c78-b1f3-233cd04eade0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:26.470081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57e17b-b3d7-4c78-b1f3-233cd04eade0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:26.484203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 376/737] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:26.484203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a787a1-dcd3-4e3a-9ae3-ba650067b279 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.484203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a787a1-dcd3-4e3a-9ae3-ba650067b279 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.484203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a787a1-dcd3-4e3a-9ae3-ba650067b279 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.488271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 377/738] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:26.489074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a787a1-dcd3-4e3a-9ae3-ba650067b279 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.566939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc843c4-8ed0-428c-9c12-206c58d6c73c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:26.568077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.601091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.608352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd3fa2-98a7-4e6a-befc-af2bd8f850be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:26.609472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd3fa2-98a7-4e6a-befc-af2bd8f850be None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.609905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd3fa2-98a7-4e6a-befc-af2bd8f850be None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.610342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd3fa2-98a7-4e6a-befc-af2bd8f850be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.622915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd3fa2-98a7-4e6a-befc-af2bd8f850be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:26.624695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd3fa2-98a7-4e6a-befc-af2bd8f850be None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:26.629300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a787a1-dcd3-4e3a-9ae3-ba650067b279 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-00cd3fa2-98a7-4e6a-befc-af2bd8f850be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:26.647362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:26.648442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:26.649500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:26.649500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:26.649500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:26.649500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 362/739] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:26.651679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b82d8-8ab9-4d1b-bfea-a4500cf5410d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.652097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b82d8-8ab9-4d1b-bfea-a4500cf5410d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.652471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b82d8-8ab9-4d1b-bfea-a4500cf5410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.669936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:26.670890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.671354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.671809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.675455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b46b82d8-8ab9-4d1b-bfea-a4500cf5410d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:26.676688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b46b82d8-8ab9-4d1b-bfea-a4500cf5410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:26.683879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:26.685572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:26.701443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:26.702403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:26.703293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:26.703293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:26.703293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:26.705389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 378/740] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:26.706403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.755170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 363/741] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 21:19:26.756006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b82d8-8ab9-4d1b-bfea-a4500cf5410d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.820257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8073a7-3d46-421c-9f68-2b80eadfeafd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:26.831906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.865963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:26.866835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.867322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.867799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.868724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:26.869936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:26.871881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:26.886434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b82d8-8ab9-4d1b-bfea-a4500cf5410d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:26.887654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 379/742] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:26.889570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:26.900273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.925531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:26.927682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:26.927981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:26.928258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:26.928952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:26.929281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:26.931201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:26.946668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 364/743] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:26.948165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.015252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cc63d-6d27-434b-81a7-7b4d3f19c9e3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.056446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.057688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.057972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.058251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.059118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.060550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.069142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36277b2-9b5b-4ed7-8c9f-011ae2646ea5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.104355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.105225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.105407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.105677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.112500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.114023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:27.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:27.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 365/744] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:27.137554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.153023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 380/745] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:19:26 2022] POST /identity/v3/services => generated 240 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:27.154391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.162375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:27.205281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:27.250621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9eeaf-7869-4620-a6f5-ef50bb43342a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.298294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.299056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.299270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.299583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.309374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.310992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.311642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05323b-adef-4dfe-90b5-857d1b041552 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:27.325770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:27.326789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:27.327733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 366/746] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:27.328332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.360689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.361323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.361601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.361869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.376142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:27.380894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:27.381962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:27.382803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:27.384297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 381/747] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:27.385291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.448578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:27.457885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490b73e-3bdf-4b83-80a2-6653e5048aff None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.481172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:27.495311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e6278-1106-43e4-9860-9aa7e59cd45b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.499693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.500365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.500645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.500915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.501642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:27.501943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.503373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.516330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 367/748] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:27.517247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.540516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.542275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.543045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.543529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.544625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:27.545117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.546964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.570929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 382/749] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:27.571982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.634400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd987ed-b9c4-4d5c-bb31-49162daf31a3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.680697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.681504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.682756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.683125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.683987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:27.684382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.685854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.697603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82da7c-6767-495a-9f10-72e705290c28 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.699941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 368/750] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:27.701651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.715203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:27.742754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.743708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.744554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.745103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.746035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ed6b146dd405411db127d9668822cbc4) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:27.746942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.748914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.756631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 383/751] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/role_assignments?user.id=ed6b146dd405411db127d9668822cbc4&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:27.757666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.771989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:27.874904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e765a-7523-401f-ab6f-94285de50853 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.883535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db137c88-3d19-4262-a7ef-93a679aa7ac2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:27.924562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.925264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.925548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.925826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:27.939353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:27.940839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:27.958372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:27.959375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:27.960232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:27.960232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:27.960232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:27.960232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 384/752] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:27.966169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:27.989898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:27.990944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:27.991449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:27.991940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.015256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:28.017098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:28.039422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:28.043077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:28.044196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:28.045419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:28.045419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:28.045419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:28.047337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 369/753] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:28.052354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:28.086879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9c598-a6c8-4e1e-be98-0fdf4b60bba5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:28.136455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:28.148808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:28.149745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.151897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.152337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.153158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:28.154775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:28.156036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:28.186935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 385/754] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:28.194071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:28.224124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baa936-1673-437f-b68d-68de4e8d157a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:28.319905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976053-f943-4e4f-a939-e424593d13e9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:28.345407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:28.357759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:28.358452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.358736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.359059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.366363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:28.366677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:28.367402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.367680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.367863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:28.367958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.368784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:28.369106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:28.370982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:28.381335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:28.382337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:28.383360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:28.384233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 386/755] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:19:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:28.391932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:28.403799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 370/756] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:28.409158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:28.515476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0baa47-76ce-4a27-8ab1-91dc531dae87 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:28.561952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86712b-2608-4943-95af-df5512af671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:28.562570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86712b-2608-4943-95af-df5512af671c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.562854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86712b-2608-4943-95af-df5512af671c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.563594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86712b-2608-4943-95af-df5512af671c None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.564337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86712b-2608-4943-95af-df5512af671c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:28.565086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86712b-2608-4943-95af-df5512af671c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:28.566827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86712b-2608-4943-95af-df5512af671c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:28.587248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf84f-a4f3-4877-9468-be6ffc2a297e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:28.592939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 387/757] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Sep 9 21:19:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:28.594408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9548089-673c-4bd3-965f-a001e32df0b2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.594698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9548089-673c-4bd3-965f-a001e32df0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.594971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9548089-673c-4bd3-965f-a001e32df0b2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.597229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 388/758] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:28.599693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9548089-673c-4bd3-965f-a001e32df0b2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:28.613442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:28.624974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b51c2-bc8d-4d9c-9304-c4248f0291e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:28.625701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b51c2-bc8d-4d9c-9304-c4248f0291e1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.625984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b51c2-bc8d-4d9c-9304-c4248f0291e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.629853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b51c2-bc8d-4d9c-9304-c4248f0291e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.633249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b51c2-bc8d-4d9c-9304-c4248f0291e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:28.634886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b51c2-bc8d-4d9c-9304-c4248f0291e1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-737b51c2-bc8d-4d9c-9304-c4248f0291e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:28.646345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:28.647453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:28.649118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 371/759] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:28.654479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:28.654733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f58e43-94a4-4c7b-b5d7-acf1f205e7f9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.655114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f58e43-94a4-4c7b-b5d7-acf1f205e7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.655429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f58e43-94a4-4c7b-b5d7-acf1f205e7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.674797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-64f58e43-94a4-4c7b-b5d7-acf1f205e7f9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:28.676151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-64f58e43-94a4-4c7b-b5d7-acf1f205e7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:28.734956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9548089-673c-4bd3-965f-a001e32df0b2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:28.769370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 372/760] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:28.770712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f58e43-94a4-4c7b-b5d7-acf1f205e7f9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:28.771487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:28.772167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:28.772517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:28.772859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:28.851365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:28.853111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:28.901826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:28.957820 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f58e43-94a4-4c7b-b5d7-acf1f205e7f9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:28.969715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 389/761] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:19:28.977890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:28.979592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.014493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.015112 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.015390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.015663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.016354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:29.016657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.018283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.033916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 373/762] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:29.040851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.174148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c343-77b6-4d54-85f5-231c6f1808a8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:29.207858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e935373-496e-43e3-a73b-b86d3089989f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:29.217450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.218171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.218438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.218712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.229106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:29.231950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.234148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.243556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.244717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.258741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.258741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/97eb6832e7d246d6b6f1813763ac8a74/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.258741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=97eb6832e7d246d6b6f1813763ac8a74, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.258741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:29.259129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:29.260296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:29.261567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:29.261567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:29.261567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:29.261567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 390/763] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:29.261567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.353062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 374/764] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:29 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/97eb6832e7d246d6b6f1813763ac8a74/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:19:29.356056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.365896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff277472-2d37-4e8d-9534-e4e1fd806af3 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:29.405908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.407209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.407494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.407820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.408613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.410468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.419221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:29.422906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:29.423886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:29.424761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 391/765] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Sep 9 21:19:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:29.433281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.511783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:29.547935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46841-c04e-4644-929a-a08890ea5dbd None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:29.578450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1eec2-3808-4b27-a9e8-adb1630a295e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:29.614510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.615412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.615717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.616407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.617529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:29.617837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.619936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.621967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71609d-be8f-4cc4-a74d-b5e9dfbc2ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.622761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71609d-be8f-4cc4-a74d-b5e9dfbc2ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.623209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71609d-be8f-4cc4-a74d-b5e9dfbc2ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.623642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71609d-be8f-4cc4-a74d-b5e9dfbc2ea1 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.624424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71609d-be8f-4cc4-a74d-b5e9dfbc2ea1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:29.624875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71609d-be8f-4cc4-a74d-b5e9dfbc2ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.626523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71609d-be8f-4cc4-a74d-b5e9dfbc2ea1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.632169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 392/766] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Sep 9 21:19:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:29.633755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c44468-d91d-46a3-b95c-6c032fb6dba2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.634220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c44468-d91d-46a3-b95c-6c032fb6dba2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.634639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c44468-d91d-46a3-b95c-6c032fb6dba2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.636414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 393/767] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:29.637150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 375/768] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:29.640867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c44468-d91d-46a3-b95c-6c032fb6dba2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.642495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.751174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:29.760720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4f1bb-edeb-4a81-b61f-75f8678117da None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:29.780500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c44468-d91d-46a3-b95c-6c032fb6dba2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:29.799519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56868de-5ca2-4409-a321-150e43fcf025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.800343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56868de-5ca2-4409-a321-150e43fcf025 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.800720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56868de-5ca2-4409-a321-150e43fcf025 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.801127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56868de-5ca2-4409-a321-150e43fcf025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.807672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:29.810366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56868de-5ca2-4409-a321-150e43fcf025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.812137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56868de-5ca2-4409-a321-150e43fcf025 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.822643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:29.823242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.823520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.823806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.824465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:29.824769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f56868de-5ca2-4409-a321-150e43fcf025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:29.825050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:29.825940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:29.826992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:29.827436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:29.827514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 376/769] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:29.828674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffd289-d3bd-4e47-8b26-c92a0c87505d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:29.828674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffd289-d3bd-4e47-8b26-c92a0c87505d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:29.832419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffd289-d3bd-4e47-8b26-c92a0c87505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:29.832781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 394/770] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Sep 9 21:19:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:29.833858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.856102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d8ffd289-d3bd-4e47-8b26-c92a0c87505d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:29.857415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d8ffd289-d3bd-4e47-8b26-c92a0c87505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:29.928658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 377/771] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:29.930328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffd289-d3bd-4e47-8b26-c92a0c87505d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:29.985041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044bc2f-e0e8-4b6c-b4a2-bbe7db89fe33 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:30.062346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:30.073753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffd289-d3bd-4e47-8b26-c92a0c87505d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:30.077726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:30.078355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.078637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.078911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.079620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:30.079926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:30.081385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:30.107462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 395/772] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:30.111458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:30.112078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.112629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.112912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.113401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:30.113722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] RBAC: Adding query filter params (interface=public, service_id=af3f93efc2d245f4bd8273fa7092b267, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:30.114127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:30.115748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:30.125368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 378/773] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:19:29 2022] GET /identity/v3/endpoints?service_id=af3f93efc2d245f4bd8273fa7092b267&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:30.136316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:30.212409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:30.297333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c0404-3011-438a-a791-86ad4408f732 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:30.309879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560a8d-787b-403d-a691-a723d9d7652a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:30.335964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:30.336497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.336780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.337074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.337835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ee17ca4bc9cc441b9be64129c7ebb212) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:30.338690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:30.340162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:30.345675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 396/774] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:30 2022] GET /identity/v3/role_assignments?user.id=ee17ca4bc9cc441b9be64129c7ebb212&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:30.346291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13cfd-af75-47e8-9124-2f4bccec1f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:30.346465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:30.347481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13cfd-af75-47e8-9124-2f4bccec1f07 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.347761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13cfd-af75-47e8-9124-2f4bccec1f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.348034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13cfd-af75-47e8-9124-2f4bccec1f07 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.348642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad13cfd-af75-47e8-9124-2f4bccec1f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:30.350066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad13cfd-af75-47e8-9124-2f4bccec1f07 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:30.356953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 379/775] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:19:30 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:30.358257 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6185c-14d6-4acb-b6f2-ff8ae53f3678 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.358538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6185c-14d6-4acb-b6f2-ff8ae53f3678 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.358806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6185c-14d6-4acb-b6f2-ff8ae53f3678 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.364029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 380/776] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:30.365970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa89951-8f3d-42da-a078-78a97cf4833f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.366253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa89951-8f3d-42da-a078-78a97cf4833f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.366525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa89951-8f3d-42da-a078-78a97cf4833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.390589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3aa89951-8f3d-42da-a078-78a97cf4833f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:30.392113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3aa89951-8f3d-42da-a078-78a97cf4833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:30.396214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:30.495114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456ccc-0930-4648-aeb3-56002afbade2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:30.505845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:30.537647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:30.538781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.539217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.539644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.540398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:30.542212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:30.551777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 381/777] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:30.557672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:30.558926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:30.559875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:30.562169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 397/778] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:30 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:30.568387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa89951-8f3d-42da-a078-78a97cf4833f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:30.694845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa89951-8f3d-42da-a078-78a97cf4833f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:30.730698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:30.731311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.731583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.731846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.732469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:30.732764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:30.734157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:30.739180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 382/779] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:30.745107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:30.869387 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c5242-2526-4d87-b354-6dc6ddc379e9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:30.889199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:30.897135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:30.929788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:30.930456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:30.930730 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:30.930995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:30.931827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:30.932169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:30.933549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:30.945764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 398/780] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:30.952553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:31.030665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:31.053447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3586a7-81c6-4bce-b41b-5064443c6bb2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:31.114175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:31.114806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.115078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.115349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:31.134575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:31.140428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:31.141405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:31.142254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:31.142882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 383/781] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:31.149567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f626e8-0fcb-4fc2-a81e-e9d82c6e96c7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:31.152621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:31.194748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:31.195359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.195635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.195959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:31.196607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] RBAC: Adding query filter params (interface=public, service_id=45b4a972d916488c8a44a0cf63c86023, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:31.196915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:31.198352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:31.208878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 399/782] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:19:30 2022] GET /identity/v3/endpoints?service_id=45b4a972d916488c8a44a0cf63c86023&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:31.216336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:31.285457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:31.359558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c60b4e-bc04-4c2d-9269-d7b356999163 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:31.387216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:31.395660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01720-abbf-4379-877d-efe3ae94a579 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:31.418986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:31.419606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.419879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.420143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:31.420806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:31.421127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:31.422488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:31.444077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5707-2756-4119-9857-113e86772650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:31.444618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 384/783] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:31.444832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5707-2756-4119-9857-113e86772650 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.445138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5707-2756-4119-9857-113e86772650 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.445455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5707-2756-4119-9857-113e86772650 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:31.446183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba5707-2756-4119-9857-113e86772650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:31.447560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba5707-2756-4119-9857-113e86772650 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:31.449221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:31.464028 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 400/784] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:19:31 2022] GET /identity/v3/services => generated 772 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:31.596450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7203c-451c-4cb5-98f3-b2521ad35b4d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:31.629342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:31.640579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:31.641255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.641533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.641799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:31.656008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:31.657488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:31.673462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:31.674497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:31.675409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:31.675409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:31.675409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:31.675409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 385/785] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:31.686244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5707-2756-4119-9857-113e86772650 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:31.842556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5707-2756-4119-9857-113e86772650 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:31.904432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2585781-86f4-40d2-980b-8457b707f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:31.905466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2585781-86f4-40d2-980b-8457b707f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.920811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2585781-86f4-40d2-980b-8457b707f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.920811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2585781-86f4-40d2-980b-8457b707f9e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:31.920811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2585781-86f4-40d2-980b-8457b707f9e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:31.920811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2585781-86f4-40d2-980b-8457b707f9e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:31.920811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2585781-86f4-40d2-980b-8457b707f9e3 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:31.936566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 401/786] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:31.941872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:31.960127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79bf31-136b-4e07-ae78-92e20080df55 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.960464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79bf31-136b-4e07-ae78-92e20080df55 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.960739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79bf31-136b-4e07-ae78-92e20080df55 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:31.962084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 402/787] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:31.984962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745da1d-96f8-454d-aaf4-ecf9b38d29a1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:31.985349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745da1d-96f8-454d-aaf4-ecf9b38d29a1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:31.985544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745da1d-96f8-454d-aaf4-ecf9b38d29a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:32.019400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9745da1d-96f8-454d-aaf4-ecf9b38d29a1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:32.019717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9745da1d-96f8-454d-aaf4-ecf9b38d29a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:32.041945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:32.133771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 403/788] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:32.134067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ef21-a491-4bba-97f5-04021334c654 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:32.222985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:32.224025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:32.224524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:32.224996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:32.244533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:32.246063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:32.281381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:32.282370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:32.283905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 386/789] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:32.294193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745da1d-96f8-454d-aaf4-ecf9b38d29a1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:32.447545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745da1d-96f8-454d-aaf4-ecf9b38d29a1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:32.492303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:32.493624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:32.494708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:32.495402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:32.496333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:32.496856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:32.502497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:32.523595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 404/790] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Sep 9 21:19:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:32.528947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:32.548393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:32.582720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:32.659526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:32.707368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069e05-a49e-40e7-bc14-96c7469ebcd4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:32.744582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:32.745515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:32.745941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:32.746384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:32.757293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:32.762847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:32.764003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:32.764964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:32.771670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 405/791] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:32.773065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:32.791761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c4f91-dfa0-448e-98f9-93704f89061a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:32.851351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:32.884511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9d6e-c70f-4596-bbf1-c9188dc35a5e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:32.891526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:32.892174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:32.892449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:32.892719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:32.913819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:32.915301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:32.929196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:32.929871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:32.930152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:32.930425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:32.931358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:32.931694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:32.934801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:32.943082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:32.946919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:32.949205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:32.949205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:32.949205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:32.949205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 387/792] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:32.953217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:32.957227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 406/793] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:32.963514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:33.058952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:33.077712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29fc59-dbfd-4309-bf8f-26bd8a5af6ab None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:33.140496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1283b-7091-4955-8b25-fc750f5bf3d2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:33.173814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b36139-7df9-4445-95af-80a071ec4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:33.174438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36139-7df9-4445-95af-80a071ec4312 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.174929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36139-7df9-4445-95af-80a071ec4312 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.175402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36139-7df9-4445-95af-80a071ec4312 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.176222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36139-7df9-4445-95af-80a071ec4312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:33.176695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36139-7df9-4445-95af-80a071ec4312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:33.178269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36139-7df9-4445-95af-80a071ec4312 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:33.185781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bba4-43ae-4251-92d6-44714110c535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:33.186718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bba4-43ae-4251-92d6-44714110c535 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.187320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bba4-43ae-4251-92d6-44714110c535 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.187804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bba4-43ae-4251-92d6-44714110c535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.192413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 388/794] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:33.193922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7686-6ecf-4dc4-8d0c-1049c01e481c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.194423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7686-6ecf-4dc4-8d0c-1049c01e481c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.194902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7686-6ecf-4dc4-8d0c-1049c01e481c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.196534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 389/795] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:33.198418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7686-6ecf-4dc4-8d0c-1049c01e481c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:33.201370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:33.206750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06bba4-43ae-4251-92d6-44714110c535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:33.208266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06bba4-43ae-4251-92d6-44714110c535 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-dc06bba4-43ae-4251-92d6-44714110c535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:33.226197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:33.227159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:33.228047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:33.228047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:33.228047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:33.228047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 407/796] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:33.229346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc1bd-60f2-4875-88df-504775b26dbd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.229450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc1bd-60f2-4875-88df-504775b26dbd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.229651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc1bd-60f2-4875-88df-504775b26dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.255172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-56ebc1bd-60f2-4875-88df-504775b26dbd None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:33.256794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-56ebc1bd-60f2-4875-88df-504775b26dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:33.323397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7686-6ecf-4dc4-8d0c-1049c01e481c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:33.342271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 408/797] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:33.343438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebc1bd-60f2-4875-88df-504775b26dbd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:33.365191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cfeab-e01c-4832-948d-3cbfc59c0523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:33.365858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cfeab-e01c-4832-948d-3cbfc59c0523 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.366137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cfeab-e01c-4832-948d-3cbfc59c0523 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.366408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cfeab-e01c-4832-948d-3cbfc59c0523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.374401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cfeab-e01c-4832-948d-3cbfc59c0523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:33.375845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cfeab-e01c-4832-948d-3cbfc59c0523 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ea7cfeab-e01c-4832-948d-3cbfc59c0523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:33.387817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:33.388726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:33.389636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 390/798] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:33.391900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880cc7c-78cf-44b6-874b-476604f7dc1d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.391900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880cc7c-78cf-44b6-874b-476604f7dc1d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.391900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880cc7c-78cf-44b6-874b-476604f7dc1d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.393064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 391/799] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:33.394990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880cc7c-78cf-44b6-874b-476604f7dc1d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:33.408648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:33.461390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebc1bd-60f2-4875-88df-504775b26dbd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:33.483034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:33.503585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f381a37-8fc1-44e5-876b-2ae459dd4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:33.504192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381a37-8fc1-44e5-876b-2ae459dd4bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.504468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381a37-8fc1-44e5-876b-2ae459dd4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.507747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f381a37-8fc1-44e5-876b-2ae459dd4bb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.507747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f381a37-8fc1-44e5-876b-2ae459dd4bb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:33.507747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f381a37-8fc1-44e5-876b-2ae459dd4bb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:33.507747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f381a37-8fc1-44e5-876b-2ae459dd4bb5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:33.518726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880cc7c-78cf-44b6-874b-476604f7dc1d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:33.520529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 409/800] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:33.522378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a510fd7-c8dc-4b8a-b7e5-f09ad11dcd28 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.522378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a510fd7-c8dc-4b8a-b7e5-f09ad11dcd28 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.522378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a510fd7-c8dc-4b8a-b7e5-f09ad11dcd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.542465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4a510fd7-c8dc-4b8a-b7e5-f09ad11dcd28 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:33.543613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4a510fd7-c8dc-4b8a-b7e5-f09ad11dcd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:33.558376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:33.559385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.559866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.560401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.561353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:33.561862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:33.563717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:33.577374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 392/801] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:33.578428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:33.629056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 410/802] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:33.629056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a510fd7-c8dc-4b8a-b7e5-f09ad11dcd28 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:33.678009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:33.718769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d9261-97c1-4714-83dc-0d79cf683b63 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:33.738167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a510fd7-c8dc-4b8a-b7e5-f09ad11dcd28 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:33.755629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:33.764309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:33.765158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.765602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.766026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.783593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:33.784364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:33.784726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:33.785108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ed6b146dd405411db127d9668822cbc4/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:33.787205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=ed6b146dd405411db127d9668822cbc4, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:33.788738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:33.872713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 411/803] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:33 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ed6b146dd405411db127d9668822cbc4/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:19:33.874102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:33.898436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:33.899922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:33.922656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:33.923696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:33.924642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 393/804] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:19:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:33.934116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.028604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e9bab-8caf-41f5-91c1-b9045dccd47b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.060146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccabcf7-0c79-4be6-b4e8-2c46a8b3f8d8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.086679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.086679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.086956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.087166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.100259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.105362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:34.107460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.108089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.108366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.108635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.109617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:34.109925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:34.110774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:34.116770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:34.117711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:34.118374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.118449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 412/805] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:34.118449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.136840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 394/806] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:19:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:34.138032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.159079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.255466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aba90-ed04-4d7d-a0bc-aaa0ed571e2c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.255956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801059f-f9eb-445e-9f77-3ac02380d3ca None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.293567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.294099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.294377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.294644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.295300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:34.295600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.296697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bcedb-d5e6-48d5-836e-4748c51d758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.296968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.297480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bcedb-d5e6-48d5-836e-4748c51d758b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.297760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bcedb-d5e6-48d5-836e-4748c51d758b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.298027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bcedb-d5e6-48d5-836e-4748c51d758b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.298601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bcedb-d5e6-48d5-836e-4748c51d758b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.299942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bcedb-d5e6-48d5-836e-4748c51d758b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.311130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 395/807] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:34.311130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ba1bcedb-d5e6-48d5-836e-4748c51d758b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:34.311379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:34.312291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:34.313141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 413/808] 10.222.0.60 () {56 vars in 1129 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:34.313925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91c8ed-b5a5-416e-b41f-638f3c48483a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.313925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91c8ed-b5a5-416e-b41f-638f3c48483a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.313925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91c8ed-b5a5-416e-b41f-638f3c48483a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.317479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 414/809] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:34.318227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91c8ed-b5a5-416e-b41f-638f3c48483a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.368182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.415716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.420817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d980df4-abb8-42c5-a154-4f9050764eb5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.427037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91c8ed-b5a5-416e-b41f-638f3c48483a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.458051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.458646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.458930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.459210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.463813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.463813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.464066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.464151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.475025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.476632 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:34.493197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:34.494198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:34.495251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:34.495251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:34.495251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:34.495251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 415/810] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:34.495474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.538083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.539586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.593000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.601800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6bdd6-fd3a-4197-8ab4-5880e30fb53f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.638122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740f5b-8bfa-4f8d-a740-4c0ed1126126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.638740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740f5b-8bfa-4f8d-a740-4c0ed1126126 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.639021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740f5b-8bfa-4f8d-a740-4c0ed1126126 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.639298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740f5b-8bfa-4f8d-a740-4c0ed1126126 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.639938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740f5b-8bfa-4f8d-a740-4c0ed1126126 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:34.640244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740f5b-8bfa-4f8d-a740-4c0ed1126126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.641639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740f5b-8bfa-4f8d-a740-4c0ed1126126 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.646365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 416/811] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:34.647519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13197c9-bca5-43ef-80e6-d1184cff250b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.647808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13197c9-bca5-43ef-80e6-d1184cff250b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.648086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13197c9-bca5-43ef-80e6-d1184cff250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.659531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 396/812] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:19:34.660660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.661540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.667883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f13197c9-bca5-43ef-80e6-d1184cff250b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:34.669130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f13197c9-bca5-43ef-80e6-d1184cff250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:34.742314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 417/813] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:34.743160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13197c9-bca5-43ef-80e6-d1184cff250b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.790141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37573ce-5473-492f-a150-3552376c9102 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.828531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.829562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.830038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.830527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.831388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:34.831893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.834293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.859046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 397/814] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:34.859046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.874051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.878592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13197c9-bca5-43ef-80e6-d1184cff250b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:34.918204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:34.919411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:34.920308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:34.920916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:34.922002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:34.922539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:34.924180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:34.927493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:34.936704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 418/815] 10.222.0.60 () {56 vars in 1124 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:34.938767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:34.970691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020918c-ea2c-4171-b2a6-e5450135d5b8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.008150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.009008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.009408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.009883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.021603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.023506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:35.039163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:35.040143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:35.041731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:35.041731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:35.041731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:35.041731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 398/816] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:35.041731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.059892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451a78a-9e1e-461d-8aca-83f53ed66e71 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.097433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.098174 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.098477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.098868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.107134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.108673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.109692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:35.121476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:35.122498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:35.123444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 419/817] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:19:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:35.124040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.152739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab31d0-1407-4bc6-aff9-7f3232ad36df None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.185893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:35.187807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.188427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.188702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.188974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.189667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.191038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.230857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef8a15-b3e4-419a-88c1-bc4d3d303d4f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.265092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.266050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.266050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] PATH_INFO: `/v3/services/network` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.266832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.268183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:35.276863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:35.277965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:35.278857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 420/818] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:35.279727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.309504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 399/819] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:19:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:35.310814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.407227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f150c4-8669-4759-ac38-884567fd9717 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.435013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:35.459639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.460368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.460709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.461065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.461920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:35.462288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.463925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.464214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0ae7-491d-42ea-bcda-a8c94c332c00 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.479116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 421/820] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:35.480121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.483148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:35.511058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.511667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.511947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.512339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.512962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:35.513527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.514802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.535988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 400/821] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:35.536839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.612640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546fc6a-02bf-4aa9-b58b-5e9eef0ce1b0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.654597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.655361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.655650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.655920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.656592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] RBAC: Adding query filter params (name=network) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:35.656899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.658339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.659470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c0686-6504-4622-a037-94bb514c9afc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.664342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 422/822] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:35.664973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.710984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.712598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.713128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.714056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.717999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:35.726388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.729700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:35.746165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:35.747110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:35.748004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 401/823] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:35.748485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.786555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aba13-32f4-4e23-a101-0595d7f56d66 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.798511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:35.828110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.828961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.829373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.829746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.847697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.849640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:35.866598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:35.867720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:35.868859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:35.868859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:35.868859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:35.875548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 423/824] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:35.875548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.892391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a33d-f640-4be3-85cc-1782ebf63dd5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:35.930576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:35.931980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:35.932374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:35.932745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:35.933528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] RBAC: Adding query filter params (type=network) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:35.933935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:35.935484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:35.941060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 402/825] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:35.942040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:35.986158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:35.994764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe904-2f31-4bde-852a-66736844be99 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.036052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.036758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.037133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.037481 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.038237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:36.038614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:36.040103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:36.057158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 424/826] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:36.057158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:36.067702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:36.075611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74e4b5-8bb2-4dbc-99cd-60c227a9e2af None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.120215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.121114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.121565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.122106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.123038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:36.123523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:36.125211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:36.143912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 403/827] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:36.145246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:36.175093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026daf6a-f34b-4465-8eb2-03e4059e88c7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.216566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb520c65-d425-4cc8-a583-0dfc4071d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.217525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb520c65-d425-4cc8-a583-0dfc4071d894 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.217817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb520c65-d425-4cc8-a583-0dfc4071d894 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.218243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb520c65-d425-4cc8-a583-0dfc4071d894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.218913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb520c65-d425-4cc8-a583-0dfc4071d894 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:36.220268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb520c65-d425-4cc8-a583-0dfc4071d894 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:36.256699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96f03-0bae-45af-a939-a85089370022 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.288830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.289475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.289760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.290032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.291306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=97eb6832e7d246d6b6f1813763ac8a74) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:36.291674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:36.293236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:36.298784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 404/828] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:36 2022] GET /identity/v3/role_assignments?user.id=97eb6832e7d246d6b6f1813763ac8a74&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:36.299551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:36.318903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 425/829] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:19:36 2022] POST /identity/v3/endpoints => generated 337 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:36.320846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c935de7-f54a-4e64-b0bd-adb7871f83b2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.327267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c935de7-f54a-4e64-b0bd-adb7871f83b2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.327769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c935de7-f54a-4e64-b0bd-adb7871f83b2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.329801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 426/830] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:36.334582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:36.337578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c731523-80e7-4c26-9421-0bfe35ff20ee None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.338711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c731523-80e7-4c26-9421-0bfe35ff20ee None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.339041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c731523-80e7-4c26-9421-0bfe35ff20ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.381576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6c731523-80e7-4c26-9421-0bfe35ff20ee None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:36.382847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6c731523-80e7-4c26-9421-0bfe35ff20ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:36.401225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:36.490101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 427/831] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:36.504249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c5aac-64e4-48db-b561-22ac85db7f59 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.554275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.555023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.555309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.555580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.565447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:36.566901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:36.578682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:36.579610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:36.580522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 405/832] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:36.585559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c731523-80e7-4c26-9421-0bfe35ff20ee None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:36.697024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c731523-80e7-4c26-9421-0bfe35ff20ee None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.733712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.734672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.735153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.735622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.736508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:36.737086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:36.738710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:36.746337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:36.752412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 428/833] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:36.758221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:36.813107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:36.843026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:36.866474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5c97-6f5e-45b5-b640-dcb3fe69acd3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.904458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.905146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.905423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.905689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ee17ca4bc9cc441b9be64129c7ebb212/roles/94b322ecf59e4767888638fc0e33204e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.925192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=ee17ca4bc9cc441b9be64129c7ebb212, role_id=94b322ecf59e4767888638fc0e33204e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:36.926922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:36.939301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2422e6a-9c1b-4080-98ba-cd6ce2c3eeba None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:36.974776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:36.975530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:36.975811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:36.976082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:36.989463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:36.998975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:36.999883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:37.002896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 429/834] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:37.006043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:37.013308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 406/835] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:36 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ee17ca4bc9cc441b9be64129c7ebb212/roles/94b322ecf59e4767888638fc0e33204e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:19:37.078886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:37.128607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e15ff-b1b9-4fc7-b111-2e762a8609c7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:37.167469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:37.168494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:37.168974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:37.169498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:37.170378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:37.170881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:37.172478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:37.183073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 430/836] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:37.189083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:37.309526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1bedb-85a4-4256-86d4-a4e9edc04b4d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:37.340354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:37.346296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:37.347192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:37.347467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:37.355516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:37.358943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:37.360394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:37.375045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:37.376025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:37.377634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:37.377634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:37.377634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:37.377634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 407/837] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:37.382120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:37.491558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b7eb-7677-4062-b57f-b8552ac92441 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:37.511527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:37.525902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d7294-924b-4397-b92a-96bd5a59fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:37.527161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d7294-924b-4397-b92a-96bd5a59fca0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:37.527161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d7294-924b-4397-b92a-96bd5a59fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:37.527161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d7294-924b-4397-b92a-96bd5a59fca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:37.527718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d7294-924b-4397-b92a-96bd5a59fca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:37.528015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d7294-924b-4397-b92a-96bd5a59fca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:37.529449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d7294-924b-4397-b92a-96bd5a59fca0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:37.543148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 431/838] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:37.549017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:37.660432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f0cc2-4393-42b9-a5b2-845f6ef9d728 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:37.669284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581fa1f-1784-4843-b82b-d17a887f4b5e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:37.669569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581fa1f-1784-4843-b82b-d17a887f4b5e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:37.669842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581fa1f-1784-4843-b82b-d17a887f4b5e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:37.671640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 432/839] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:37.676394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13723c-2cff-4242-8881-7e17ccc763eb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:37.676672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13723c-2cff-4242-8881-7e17ccc763eb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:37.677282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13723c-2cff-4242-8881-7e17ccc763eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:37.695009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0d13723c-2cff-4242-8881-7e17ccc763eb None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:37.696141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0d13723c-2cff-4242-8881-7e17ccc763eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:37.699873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:37.700548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:37.700832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:37.701132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:37.708874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:37.710335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:37.722872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:37.723829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:37.724777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 408/840] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:19:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:37.730422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:37.783330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:37.793257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 433/841] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:37.848984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12104a7f-9ea2-4dc5-b12c-6afdce07d434 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:37.886075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:37.886690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:37.886969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:37.887242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:37.887973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:37.888278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:37.889800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:37.908665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 409/842] 10.222.0.60 () {56 vars in 1135 bytes} [Fri Sep 9 21:19:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:37.916598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13723c-2cff-4242-8881-7e17ccc763eb None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.024305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13723c-2cff-4242-8881-7e17ccc763eb None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:38.036061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:38.060009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:38.060624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.060902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.061204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.096014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.136611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:38.138099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:38.200594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:38.203365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ef26a-a502-47ef-a208-d2115855f03c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:38.243631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:38.244872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.245261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.245586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.246283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:38.247769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:38.257893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 434/843] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:38.263042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:38.264026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:38.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 410/844] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:38.266863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.270695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.301413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:38.386037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f030-c60d-483e-a29e-7e062d7ca4bc None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:38.391055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82638723-053d-45cd-bdd1-fc95b7008238 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:38.424656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176572-29ef-40cc-bf22-988610490351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:38.425692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176572-29ef-40cc-bf22-988610490351 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.425975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176572-29ef-40cc-bf22-988610490351 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.426243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176572-29ef-40cc-bf22-988610490351 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.427152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176572-29ef-40cc-bf22-988610490351 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:38.427456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176572-29ef-40cc-bf22-988610490351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:38.428814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176572-29ef-40cc-bf22-988610490351 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:38.432310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:38.433239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.433712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.434173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.434396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 411/845] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:38.439539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176572-29ef-40cc-bf22-988610490351 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.447921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:38.449578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:38.470891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:38.472177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:38.473093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:38.473093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:38.473093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:38.473093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 435/846] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:38.479820 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:38.481821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.557669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176572-29ef-40cc-bf22-988610490351 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:38.570712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:38.594356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:38.595012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.595288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.595630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.596721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:38.596867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:38.598274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:38.617072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 412/847] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:38.633698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b51b-0c9d-4133-ab0d-d660d9e8e31c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:38.675028 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6187e2-ad99-43a8-ada3-99f0cd2031f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:38.675648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6187e2-ad99-43a8-ada3-99f0cd2031f8 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.675922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6187e2-ad99-43a8-ada3-99f0cd2031f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.676188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6187e2-ad99-43a8-ada3-99f0cd2031f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.676840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6187e2-ad99-43a8-ada3-99f0cd2031f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:38.677174 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6187e2-ad99-43a8-ada3-99f0cd2031f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:38.678564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6187e2-ad99-43a8-ada3-99f0cd2031f8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:38.692608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 436/848] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:38.698962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.718899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba688a-0609-4ff0-b2e9-eae39a374d36 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.719221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba688a-0609-4ff0-b2e9-eae39a374d36 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.719460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba688a-0609-4ff0-b2e9-eae39a374d36 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.725343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 437/849] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:38.727008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b26d-36c3-4766-b65a-0747f736d431 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.727293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b26d-36c3-4766-b65a-0747f736d431 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.727570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516b26d-36c3-4766-b65a-0747f736d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.746760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0516b26d-36c3-4766-b65a-0747f736d431 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:38.748763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0516b26d-36c3-4766-b65a-0747f736d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:38.821135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:38.826252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 438/850] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:38.833977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ac85-b7a9-4014-8d0a-990fde3ebba4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:38.874901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:38.876286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:38.876774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:38.877283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:38.885737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:38.888802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:38.902233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:38.903161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:38.921571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 413/851] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:38.922201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516b26d-36c3-4766-b65a-0747f736d431 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:38.975658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:39.024626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516b26d-36c3-4766-b65a-0747f736d431 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:39.060867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:39.061852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.062279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.062747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.063580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:39.064031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:39.065698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:39.079181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 439/852] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:39.085454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:39.115929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:39.203792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a9985-f3e8-46b2-a2e6-b22fca879bf1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:39.247052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b9d5e-91cc-4ba9-9842-c4c8ca160bbd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:39.254732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:39.255491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.256297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.256581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.257363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ed6b146dd405411db127d9668822cbc4) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:39.258111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:39.260563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:39.263563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:39.270015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 414/853] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:39 2022] GET /identity/v3/role_assignments?user.id=ed6b146dd405411db127d9668822cbc4&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:39.291853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1f85f-cc80-44f9-9671-09a844e9f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:39.292584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f85f-cc80-44f9-9671-09a844e9f1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.292865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f85f-cc80-44f9-9671-09a844e9f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.293254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f85f-cc80-44f9-9671-09a844e9f1a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.293863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1f85f-cc80-44f9-9671-09a844e9f1a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:39.295419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1f85f-cc80-44f9-9671-09a844e9f1a4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f6c1f85f-cc80-44f9-9671-09a844e9f1a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:39.305924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:39.307254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:39.308398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:39.311331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 440/854] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Sep 9 21:19:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:39.317592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:39.339234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe251c-0197-4380-9f68-7f8228b80feb None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.339509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe251c-0197-4380-9f68-7f8228b80feb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.339778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe251c-0197-4380-9f68-7f8228b80feb None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.340756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:39.341958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 441/855] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:39.348270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b3a0-c23a-4cab-b4be-b8ba0e65b62d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.348561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b3a0-c23a-4cab-b4be-b8ba0e65b62d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.348863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b3a0-c23a-4cab-b4be-b8ba0e65b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.374158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5216b3a0-c23a-4cab-b4be-b8ba0e65b62d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:39.375803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5216b3a0-c23a-4cab-b4be-b8ba0e65b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:39.440862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c1dcc-b2de-4072-80e6-94552370e439 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:39.481056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 442/856] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:39.484666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:39.485835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.485835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.485835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.486805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:39.486805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:39.488187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:39.493046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 415/857] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:39.499334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b3a0-c23a-4cab-b4be-b8ba0e65b62d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:39.603802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b3a0-c23a-4cab-b4be-b8ba0e65b62d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:39.611794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:39.640651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:39.641728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.642214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.642689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.643553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:39.644081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:39.645732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:39.652298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 443/858] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:39.748476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:39.841924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:39.864628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aacfa-378b-4e82-8331-333cec2e0318 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:39.899344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:39.900750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:39.901109 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:39.901310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:39.912006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:39.917926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:39.918845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:39.919914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 416/859] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:39.926940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:40.034060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4716fc-aeb7-4424-a97b-2894b9c21f20 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:40.070661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:40.071275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:40.071562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:40.071929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:40.072707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:40.073012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:40.074402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:40.083305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 444/860] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:40.089217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:40.202069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978266f-8232-4317-93b7-026094dfefcb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:40.242224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:40.242854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:40.243133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:40.243404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:40.253045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:40.255039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:40.256494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:40.271694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:40.276338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:40.277238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:40.277238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:40.277238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:40.277238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 417/861] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:40.281523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:40.318619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:40.389909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbd1c9-6804-43c9-948e-4e5df3166ac2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:40.430756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:40.432076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:40.432506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:40.432924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:40.433908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:40.434227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:40.435677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:40.448896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 445/862] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:40.455067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:40.562897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b9c44-60c2-44a8-b45a-522520feaede None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:40.604472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:40.604472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:40.604472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:40.604472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:40.611020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:40.612474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:40.624583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:40.625590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:40.626689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 418/863] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:19:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:40.633906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:40.731042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:40.739327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0173c-b072-451d-8bfa-138d5f4213b5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:40.773333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bef00-964a-4e4d-9006-40b52670413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:40.773937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bef00-964a-4e4d-9006-40b52670413d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:40.774294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bef00-964a-4e4d-9006-40b52670413d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:40.774570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bef00-964a-4e4d-9006-40b52670413d None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:40.775629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bef00-964a-4e4d-9006-40b52670413d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:40.775937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bef00-964a-4e4d-9006-40b52670413d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:40.777393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bef00-964a-4e4d-9006-40b52670413d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:40.799641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 446/864] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Sep 9 21:19:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:40.805572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:40.891070 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:40.926137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897abc7-d1af-43d4-ba0d-72397dd66a4f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:40.966295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:40.966975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:40.967182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:40.967460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:40.997842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632d5bc-6986-4810-971f-4cf72154b40a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:40.998340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632d5bc-6986-4810-971f-4cf72154b40a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:40.998340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632d5bc-6986-4810-971f-4cf72154b40a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:40.999880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 447/865] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:41.004978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba9749-2f9c-425c-901c-3e936e257742 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.005288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba9749-2f9c-425c-901c-3e936e257742 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.005564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba9749-2f9c-425c-901c-3e936e257742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.027602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-68ba9749-2f9c-425c-901c-3e936e257742 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:41.028701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-68ba9749-2f9c-425c-901c-3e936e257742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:41.059916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:41.061447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:41.120352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 448/866] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:41.121448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:41.173993 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 419/867] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:19:41.182265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba9749-2f9c-425c-901c-3e936e257742 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:41.269388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:41.290162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba9749-2f9c-425c-901c-3e936e257742 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:41.324509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:41.325511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.326019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.326555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.336891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:41.339408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:41.355750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:41.356702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:41.357628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:41.357628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:41.357628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:41.359716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 449/868] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:41.365275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:41.455403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:41.470563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742c97-2d2c-4dda-b80d-b81947dfac3f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:41.515862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:41.515862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.515862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.515862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.516347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:41.516347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:41.518100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:41.537191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 420/869] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:41.543752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:41.566147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:41.596835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1e4d-8af1-4747-8e23-ce67da85f904 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:41.629658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:41.638038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2d2ed-2262-46ff-b529-8f77191f56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:41.638718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2d2ed-2262-46ff-b529-8f77191f56d9 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.638943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2d2ed-2262-46ff-b529-8f77191f56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.639215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2d2ed-2262-46ff-b529-8f77191f56d9 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.639878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2d2ed-2262-46ff-b529-8f77191f56d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:41.641573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2d2ed-2262-46ff-b529-8f77191f56d9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:41.675460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105074-67c0-4109-9f2d-c998ead0bd2b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:41.710168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7525e-50b3-40aa-bbd7-36875aaa4d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:41.710794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7525e-50b3-40aa-bbd7-36875aaa4d53 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.711069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7525e-50b3-40aa-bbd7-36875aaa4d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.711334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7525e-50b3-40aa-bbd7-36875aaa4d53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.719147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7525e-50b3-40aa-bbd7-36875aaa4d53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:41.720873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7525e-50b3-40aa-bbd7-36875aaa4d53 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c7f7525e-50b3-40aa-bbd7-36875aaa4d53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:41.732290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:41.733605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:41.741548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:41.742009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 450/870] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:19:41 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:19:41.742009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997ba2e-720b-449d-bb4d-df5438e69479 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.742009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997ba2e-720b-449d-bb4d-df5438e69479 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.742009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997ba2e-720b-449d-bb4d-df5438e69479 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.742009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 451/871] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:41.742362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 421/872] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:41.742437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997ba2e-720b-449d-bb4d-df5438e69479 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:41.749466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f887-e0c9-48b7-bcbe-60431165da51 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.750088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f887-e0c9-48b7-bcbe-60431165da51 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.750513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f887-e0c9-48b7-bcbe-60431165da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.771673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-eb26f887-e0c9-48b7-bcbe-60431165da51 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:41.773267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-eb26f887-e0c9-48b7-bcbe-60431165da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:41.866145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:41.881069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 422/873] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:41.889473 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997ba2e-720b-449d-bb4d-df5438e69479 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:41.928642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769aa47-2661-413b-b587-371717dfd0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:41.930131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769aa47-2661-413b-b587-371717dfd0cb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:41.930131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769aa47-2661-413b-b587-371717dfd0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:41.930131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769aa47-2661-413b-b587-371717dfd0cb None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:41.930777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769aa47-2661-413b-b587-371717dfd0cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:41.931682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769aa47-2661-413b-b587-371717dfd0cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:41.933848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769aa47-2661-413b-b587-371717dfd0cb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:41.953149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 452/874] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:41.954756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f887-e0c9-48b7-bcbe-60431165da51 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:42.002494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57787c8-ed51-49b4-b98a-c3aef1f54386 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:42.003362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57787c8-ed51-49b4-b98a-c3aef1f54386 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:42.003639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57787c8-ed51-49b4-b98a-c3aef1f54386 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:42.005114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 453/875] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:42.010974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f361f-9c92-4c5c-a261-3e4bd2952985 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:42.011260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f361f-9c92-4c5c-a261-3e4bd2952985 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:42.011531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f361f-9c92-4c5c-a261-3e4bd2952985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:42.030812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6a9f361f-9c92-4c5c-a261-3e4bd2952985 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:42.032049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6a9f361f-9c92-4c5c-a261-3e4bd2952985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:42.078631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f887-e0c9-48b7-bcbe-60431165da51 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:42.093888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:42.115291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:42.115810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:42.116084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:42.116353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:42.117242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ee17ca4bc9cc441b9be64129c7ebb212) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:42.117550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:42.119607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:42.125336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 454/876] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:42.137058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 423/877] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:41 2022] GET /identity/v3/role_assignments?user.id=ee17ca4bc9cc441b9be64129c7ebb212&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:42.162009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f361f-9c92-4c5c-a261-3e4bd2952985 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:42.271659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f361f-9c92-4c5c-a261-3e4bd2952985 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:42.310621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:42.311671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:42.312158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:42.312631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:42.313453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:42.315031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:42.324997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:42.326084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:42.326940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:42.329766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 455/878] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:42.336043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:42.404083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:42.405806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:42.451522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecad5bb-d9e1-448c-bc60-2a3f6648062a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:42.464783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:42.486954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:42.487559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:42.487836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:42.488101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:42.488724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:42.489021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:42.490474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:42.496010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 424/879] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:42.503607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:42.522631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc69cb-c45b-4751-8061-90743fcb27cc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:42.559121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486ec8c-7fa2-468e-96af-6d50609430d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:42.560079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486ec8c-7fa2-468e-96af-6d50609430d1 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:42.560552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486ec8c-7fa2-468e-96af-6d50609430d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:42.561012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486ec8c-7fa2-468e-96af-6d50609430d1 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:42.561894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486ec8c-7fa2-468e-96af-6d50609430d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:42.563447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486ec8c-7fa2-468e-96af-6d50609430d1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:42.612862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091146-37b7-46b6-b9a3-b4afd8be22c9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:42.642041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:42.650618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad8c5d-d6ba-4fc6-b8c2-bb63abb07830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:42.651239 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad8c5d-d6ba-4fc6-b8c2-bb63abb07830 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:42.651512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad8c5d-d6ba-4fc6-b8c2-bb63abb07830 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:42.651776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad8c5d-d6ba-4fc6-b8c2-bb63abb07830 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:42.652455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad8c5d-d6ba-4fc6-b8c2-bb63abb07830 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:42.652755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad8c5d-d6ba-4fc6-b8c2-bb63abb07830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:42.654320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad8c5d-d6ba-4fc6-b8c2-bb63abb07830 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:42.665320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 456/881] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:19:42 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:42.665532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 425/881] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:44.180894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0730-b2ad-493a-8666-e830e0d7bfff None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.181507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0730-b2ad-493a-8666-e830e0d7bfff None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.181507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0730-b2ad-493a-8666-e830e0d7bfff None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.182978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 426/882] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:44.188336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6bfb-afc7-499f-9b07-6ed17310b6c5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.188738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6bfb-afc7-499f-9b07-6ed17310b6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.188907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6bfb-afc7-499f-9b07-6ed17310b6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.207624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e96c6bfb-afc7-499f-9b07-6ed17310b6c5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:44.208819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e96c6bfb-afc7-499f-9b07-6ed17310b6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:44.287758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 457/883] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:44.563510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b0730-b2ad-493a-8666-e830e0d7bfff None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:44.591216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2581ade-ad0a-488c-85a5-e68dbd50d3e6 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.592298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2581ade-ad0a-488c-85a5-e68dbd50d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.593112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2581ade-ad0a-488c-85a5-e68dbd50d3e6 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.595734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 458/884] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:44.603471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd98e9-6dd7-47b5-94cd-d43cf86d1f79 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.604986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd98e9-6dd7-47b5-94cd-d43cf86d1f79 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.605510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd98e9-6dd7-47b5-94cd-d43cf86d1f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.629768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-59dd98e9-6dd7-47b5-94cd-d43cf86d1f79 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:44.631801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-59dd98e9-6dd7-47b5-94cd-d43cf86d1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:44.667868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:44.679474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b0730-b2ad-493a-8666-e830e0d7bfff None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:44.721349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 459/885] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:44.725132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3acc48-7647-4f1b-92c7-51a60ad90f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:44.725977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3acc48-7647-4f1b-92c7-51a60ad90f0a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.726402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3acc48-7647-4f1b-92c7-51a60ad90f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.726829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3acc48-7647-4f1b-92c7-51a60ad90f0a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.727843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3acc48-7647-4f1b-92c7-51a60ad90f0a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:44.729430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3acc48-7647-4f1b-92c7-51a60ad90f0a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3c3acc48-7647-4f1b-92c7-51a60ad90f0a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:44.739260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:44.740459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:44.741373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:44.743610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 427/886] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:44.749608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd98e9-6dd7-47b5-94cd-d43cf86d1f79 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:44.869654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd98e9-6dd7-47b5-94cd-d43cf86d1f79 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:44.910752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:44.915595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.915595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.915595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.915595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:44.915595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:44.915595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:44.919732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 460/887] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:44.919892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79798bf-0566-40cd-bee4-1bbf0142c8aa None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.920111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79798bf-0566-40cd-bee4-1bbf0142c8aa None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.920394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79798bf-0566-40cd-bee4-1bbf0142c8aa None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.925079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 428/888] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:44.926743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:44.927005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88d31-3ae4-422d-87da-f413034488fc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:44.927288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88d31-3ae4-422d-87da-f413034488fc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:44.927559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88d31-3ae4-422d-87da-f413034488fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:44.954954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3cf88d31-3ae4-422d-87da-f413034488fc None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:44.956598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3cf88d31-3ae4-422d-87da-f413034488fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:44.958583 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.016799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.045056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 429/889] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:45.045056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17a27-7eea-46f4-870e-423d03494411 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.045056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17a27-7eea-46f4-870e-423d03494411 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.045056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17a27-7eea-46f4-870e-423d03494411 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.045462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e521215-675d-447b-8fca-1c0f4b706e93 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.045540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 430/890] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:45.045540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17a27-7eea-46f4-870e-423d03494411 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.080833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3b85b-56b7-4632-96f9-ea0826ccaf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.081615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b85b-56b7-4632-96f9-ea0826ccaf7e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.082209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b85b-56b7-4632-96f9-ea0826ccaf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.082486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3b85b-56b7-4632-96f9-ea0826ccaf7e None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.083366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3b85b-56b7-4632-96f9-ea0826ccaf7e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:45.083666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3b85b-56b7-4632-96f9-ea0826ccaf7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.085010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3b85b-56b7-4632-96f9-ea0826ccaf7e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.095619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 461/891] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:45.095619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ddde4-78d8-44f0-989a-6af661770143 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.095619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ddde4-78d8-44f0-989a-6af661770143 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.095619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ddde4-78d8-44f0-989a-6af661770143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.114312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c54ddde4-78d8-44f0-989a-6af661770143 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:45.115873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c54ddde4-78d8-44f0-989a-6af661770143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:45.158040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17a27-7eea-46f4-870e-423d03494411 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.201061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 462/892] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:45.201061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ddde4-78d8-44f0-989a-6af661770143 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.202551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.203245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.203588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.203951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.219393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:45.224004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:45.224517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:45.225487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:45.232232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 431/893] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:45.232938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.306353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.311720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ddde4-78d8-44f0-989a-6af661770143 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.347350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.347962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.348240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.348517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.349230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] RBAC: Adding query filter params (interface=public, service_id=e91b3efc9e63421c9fc6281257f874c5, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:45.349538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.350885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.357438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 463/894] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/endpoints?service_id=e91b3efc9e63421c9fc6281257f874c5&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:45.358081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.370403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ad6f-5a92-4a0b-9f54-3ab000d382c5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.406264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.406944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.407215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.407481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.408131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:45.408427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.410037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.423584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 432/895] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:45.423584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.449693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.465855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc392-8af5-4094-b6d1-fbd1de498e64 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.499914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.500546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.500825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.501139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.501723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.503079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:45.513120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:45.514102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:45.514989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 464/896] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:45.515810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.528851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14816540-bc67-4d70-8cb7-2b7d4b85d1c4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.536485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.563267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.563873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.564153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.564425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.565023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.566516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.573472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 433/897] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:19:45.574451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.621764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbedc51-7159-47ce-b269-39cc6eea7162 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.659136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.660052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.660331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.660605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.672934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.675212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.684678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:45.691604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:45.695347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:45.696298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:45.696298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:45.696298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:45.696298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 465/898] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:45.696298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.702271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beb925-5861-42f9-a4c2-9a5e41eb0841 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.740726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.741376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.741771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.742045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.742704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.744856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.806129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae136d-ecc9-4f2a-a886-840fd3404b1a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.820889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 434/899] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:19:45 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:45.822370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.860185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.865071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.865704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.866102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.866315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.871911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:45.871911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.871911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:45.879959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 466/900] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:45.882320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:45.947728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cbfce-6e35-440e-860e-ecb62aa79363 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:45.956592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:45.990325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:45.991231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:45.992445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:45.992869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:45.994273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:45.994890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:45.996619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.005378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28345e6b-a4a9-4d54-b07b-01affbe90610 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:46.013387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 435/901] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:46.016389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:46.043431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:46.044069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:46.044349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:46.044617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:46.045849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:46.045849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:46.046897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.053171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 467/902] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:46.059921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:46.131478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:46.142786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a07550-c36a-447e-b07f-1d0ed56a7e59 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:46.187466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a70b-979f-4c58-b708-e0a1fcff7bcb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:46.187701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:46.188201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:46.188483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:46.188756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:46.201560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:46.203278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.215764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:46.220980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:46.225576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:46.226542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 436/903] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:19:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:46.230165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:46.231798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:46.232782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:46.233604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:46.234021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:46.234925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] RBAC: Adding query filter params (interface=public, service_id=63d3cb511826454490b6de2941204557, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:46.235372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:46.236895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.248709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 468/904] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:19:46 2022] GET /identity/v3/endpoints?service_id=63d3cb511826454490b6de2941204557&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:46.250201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:46.352624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da91709-e0a5-433f-bcba-f6393437a584 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:46.386461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5cb5-888e-48c6-a9aa-95b246159eec None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:46.389409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:46.390195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:46.390653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:46.391074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:46.391940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:46.392396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:46.394002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.415391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 437/905] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Sep 9 21:19:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:46.420539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:46.435653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:46.436307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:46.437568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:46.438092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:46.438559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:46.439361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:46.440915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.453773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 469/906] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:19:46 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:19:46.538294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1afb7f-16e8-4a9e-aa01-3a13ce40d963 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:46.586024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:46.586641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:46.587039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:46.587416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:46.667153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:46.668712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.679138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:46.770454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 438/907] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:46 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:19:46.776057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:46.832021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:46.887270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c24a-3e9a-415e-8d4c-cc0c4e17a383 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:46.922923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:46.923453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:46.923731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:46.924000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:46.937257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:46.938756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:46.959380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:46.960379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:46.961307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:46.961307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:46.961307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:46.961307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 470/908] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:46.966934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:47.072671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370605e8-60b2-4c78-aaf1-4cea603ba662 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:47.082275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:47.109151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:47.109772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:47.110055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:47.115780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:47.115780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:47.115780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:47.115780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:47.124890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 439/909] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:47.130255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:47.242667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686096f4-b795-45ab-9041-a97edd020c66 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:47.244994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:47.287853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:47.288488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:47.288762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:47.289051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:47.296712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:47.298168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:47.309585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:47.311585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:47.313311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 471/910] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:47.322186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:47.425492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f2983-20c4-4204-a958-0879aeffc1f0 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:47.461196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add42aa-b3bd-4e73-a357-81d74f9da896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:47.462449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add42aa-b3bd-4e73-a357-81d74f9da896 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:47.462715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add42aa-b3bd-4e73-a357-81d74f9da896 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:47.463204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add42aa-b3bd-4e73-a357-81d74f9da896 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:47.463915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add42aa-b3bd-4e73-a357-81d74f9da896 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:47.464223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add42aa-b3bd-4e73-a357-81d74f9da896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:47.465728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add42aa-b3bd-4e73-a357-81d74f9da896 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:47.485241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 440/911] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:47.491291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:47.600483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc9c0-1edc-47ad-92bb-8f15c40ba2e1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:47.635759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2495ba-74ee-494f-9036-46f9859c254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:47.636364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2495ba-74ee-494f-9036-46f9859c254b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:47.636647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2495ba-74ee-494f-9036-46f9859c254b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:47.636923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2495ba-74ee-494f-9036-46f9859c254b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:47.637695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2495ba-74ee-494f-9036-46f9859c254b None admin] RBAC: Adding query filter params (role.id=74b34a8549e54eb7a4946a63986fbbac, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ee17ca4bc9cc441b9be64129c7ebb212) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:47.638005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2495ba-74ee-494f-9036-46f9859c254b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:47.639431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2495ba-74ee-494f-9036-46f9859c254b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:47.645328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 472/912] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:47 2022] GET /identity/v3/role_assignments?user.id=ee17ca4bc9cc441b9be64129c7ebb212&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=74b34a8549e54eb7a4946a63986fbbac => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:47.986660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb252d3-2f79-420f-a20a-9a4d860e5adc None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:47.987039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb252d3-2f79-420f-a20a-9a4d860e5adc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:47.987211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb252d3-2f79-420f-a20a-9a4d860e5adc None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:47.988797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 441/913] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:47.994130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b58da-b366-4337-a1e7-b6a5dab79caf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:47.994413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b58da-b366-4337-a1e7-b6a5dab79caf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:47.994691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b58da-b366-4337-a1e7-b6a5dab79caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.012805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2a8b58da-b366-4337-a1e7-b6a5dab79caf None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:48.014018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a8b58da-b366-4337-a1e7-b6a5dab79caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:48.037647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:48.091287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 473/914] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:48.170613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03dc97-d42d-4edc-bc36-a0173d6eeceb None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.170960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03dc97-d42d-4edc-bc36-a0173d6eeceb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.171341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03dc97-d42d-4edc-bc36-a0173d6eeceb None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.173045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 442/915] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:48.178449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff916255-aee5-4ddd-b875-afe8cd033f90 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.178737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff916255-aee5-4ddd-b875-afe8cd033f90 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.179015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff916255-aee5-4ddd-b875-afe8cd033f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.198822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ff916255-aee5-4ddd-b875-afe8cd033f90 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:48.200001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ff916255-aee5-4ddd-b875-afe8cd033f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:48.269716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 474/916] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:48.364858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03dc97-d42d-4edc-bc36-a0173d6eeceb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:48.395407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:48.481853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03dc97-d42d-4edc-bc36-a0173d6eeceb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:48.518153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:48.518789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.519071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.519345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.519936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:48.521331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:48.530336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:48.531305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:48.532528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 443/917] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:48.539616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff916255-aee5-4ddd-b875-afe8cd033f90 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:48.544971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:48.650159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:48.664365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff916255-aee5-4ddd-b875-afe8cd033f90 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:48.682599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:48.695045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17a9db-3f78-4bdb-9aaf-ebb5dbe3eba4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:48.706947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:48.707873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.708416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.708981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.709854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:48.710377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:48.712244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:48.723192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 475/918] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:48.724654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:48.736204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:48.737204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.737693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.738184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.738969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:48.740675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:48.751389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:48.752378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:48.753285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:48.756035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 444/919] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:48.763103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:48.844620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2997-d49c-4bbd-a5d4-512263c95450 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:48.875626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050405ae-3786-4d19-bf0b-062a5f28ea22 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:48.887334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e0eb6-ea59-47fe-a8b6-377150f2ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:48.887933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e0eb6-ea59-47fe-a8b6-377150f2ec6b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.888213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e0eb6-ea59-47fe-a8b6-377150f2ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.888480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e0eb6-ea59-47fe-a8b6-377150f2ec6b None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.889122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e0eb6-ea59-47fe-a8b6-377150f2ec6b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:48.889423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e0eb6-ea59-47fe-a8b6-377150f2ec6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:48.890770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e0eb6-ea59-47fe-a8b6-377150f2ec6b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:48.897067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 476/920] 10.222.0.60 () {56 vars in 1114 bytes} [Fri Sep 9 21:19:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:48.897067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da307f9-b165-4041-bde0-f6ff3d987078 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.897067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da307f9-b165-4041-bde0-f6ff3d987078 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.897363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da307f9-b165-4041-bde0-f6ff3d987078 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.898618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 477/921] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:48.904842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da307f9-b165-4041-bde0-f6ff3d987078 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:48.921684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b2d5c-926e-4e57-9a46-ae91c6b9455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:48.922305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b2d5c-926e-4e57-9a46-ae91c6b9455c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.922654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b2d5c-926e-4e57-9a46-ae91c6b9455c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.922933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b2d5c-926e-4e57-9a46-ae91c6b9455c None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.923592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b2d5c-926e-4e57-9a46-ae91c6b9455c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:48.923903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b2d5c-926e-4e57-9a46-ae91c6b9455c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:48.925144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:48.925324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b2d5c-926e-4e57-9a46-ae91c6b9455c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:48.931122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 445/922] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:48.932943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd46ba-86cb-4d1d-85e1-b4252128150a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:48.933262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd46ba-86cb-4d1d-85e1-b4252128150a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:48.933523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd46ba-86cb-4d1d-85e1-b4252128150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:48.952743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-87fd46ba-86cb-4d1d-85e1-b4252128150a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:48.957197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-87fd46ba-86cb-4d1d-85e1-b4252128150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:48.969371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:49.020114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da307f9-b165-4041-bde0-f6ff3d987078 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:49.033128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 446/923] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:49.033128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd46ba-86cb-4d1d-85e1-b4252128150a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:49.067210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:49.067908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.068289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.068660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.069564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:49.071150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:49.147973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd46ba-86cb-4d1d-85e1-b4252128150a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:49.157537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 478/924] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:19:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:19:49.200641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:49.201659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.202193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.202696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.203530 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:49.204038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:49.205661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:49.212964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 447/925] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:49.218030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:49.309936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:49.316701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:49.330437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:49.346757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58586-da82-4f0d-a9d1-f34aceb41fc8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:49.389254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:49.389831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.390113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.390786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.391082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] RBAC: Adding query filter params (interface=public, service_id=5b18f81f13a14bfab7757f9256c2db2c, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:49.391388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:49.392743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:49.397942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 479/926] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:19:49 2022] GET /identity/v3/endpoints?service_id=5b18f81f13a14bfab7757f9256c2db2c&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:49.405250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:49.449708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0319ee-e61c-4c37-b0e6-205b6a5dd505 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:49.490304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:49.490941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.491218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.491488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.492071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:49.493651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:49.503180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:49.504154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:49.505474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 448/927] 10.222.0.60 () {56 vars in 1132 bytes} [Fri Sep 9 21:19:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:49.511345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:49.537303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7101-1c0a-4edb-9b57-1ad28bd54bbf None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:49.580355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:49.580881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.581193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.581484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.582127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:49.583481 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:49.586069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:49.592566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 480/928] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:19:49 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:19:49.610721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:49.635684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac9e55-f84d-4d54-b3c6-e226db1bbd85 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:49.675254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:49.675875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.676149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.676416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.677077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:49.677383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:49.678781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:49.685683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 449/929] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:49.691423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:49.811242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905268e7-4730-4b17-b10b-b035a9db47ec None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:49.851336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907a5a-c3f9-4b2d-87dd-4cb61b4dee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:49.852755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907a5a-c3f9-4b2d-87dd-4cb61b4dee04 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.853273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907a5a-c3f9-4b2d-87dd-4cb61b4dee04 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.853713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907a5a-c3f9-4b2d-87dd-4cb61b4dee04 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.854749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77907a5a-c3f9-4b2d-87dd-4cb61b4dee04 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:49.855720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77907a5a-c3f9-4b2d-87dd-4cb61b4dee04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:49.857349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77907a5a-c3f9-4b2d-87dd-4cb61b4dee04 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:49.863623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 481/930] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:49.870105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:49.886882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05de75a-c360-4a76-bea3-1276bfada230 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.887440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05de75a-c360-4a76-bea3-1276bfada230 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.887884 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05de75a-c360-4a76-bea3-1276bfada230 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.889711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 482/931] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:49.894924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a0cc6-c39b-4190-9f5e-db98eafa0e97 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:49.895844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a0cc6-c39b-4190-9f5e-db98eafa0e97 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:49.896182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a0cc6-c39b-4190-9f5e-db98eafa0e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:49.918148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bd5a0cc6-c39b-4190-9f5e-db98eafa0e97 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:49.919634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bd5a0cc6-c39b-4190-9f5e-db98eafa0e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:49.984337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:49.996967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 483/932] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:50.005969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b6f92-59e3-49e9-975f-046b7cd926cf None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:50.043656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:50.044615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:50.045120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:50.045664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:50.046543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:50.048103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:50.057374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:50.140530 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 450/933] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:19:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:50.265718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a0cc6-c39b-4190-9f5e-db98eafa0e97 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:50.379261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a0cc6-c39b-4190-9f5e-db98eafa0e97 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:50.421654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:50.422632 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:50.423124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:50.423602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:50.434822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:50.439927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:50.440850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:19:50.441725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:50.444276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 484/934] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Sep 9 21:19:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:50.450597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:50.563729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92023d2d-2c32-4703-b688-b333552e0f99 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:50.601077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:50.602053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:50.602548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:50.603006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:50.604067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:50.604565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:50.607051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:50.616492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 451/935] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Sep 9 21:19:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:50.622205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:50.676354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:50.733492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f455b11-1753-4037-85a9-a759091f61bb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:50.769079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:50.770051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:50.770557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:50.771029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:50.782559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:50.784000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:50.798827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:50.799840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:50.800743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:50.800743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:50.800743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:50.800743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 485/936] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:50.806676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:50.867382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:50.917922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f0b99-56d3-472b-95a2-31a6d33da72e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:50.954315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:50.955000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:50.955298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:50.955568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:50.956212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:50.956512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:50.957914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:50.971623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 452/937] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:50.979089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:51.091092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425d48-05df-4c84-962c-7fe78f843b51 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:51.092593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:51.127007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:51.127636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.127910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.128176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.136199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:51.137654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:51.151324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:51.152354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:51.153354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 486/938] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:19:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:51.158656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:51.266678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133d44f-f3aa-429d-bccd-80db2a66bd8c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:51.288464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:51.307439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:51.308049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.308328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.308601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.309365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:51.309670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:51.311100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:51.329797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 453/939] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Sep 9 21:19:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:51.335639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:51.450552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc965a-9e25-48bc-92ba-7d0a7d3a2ad0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:51.485556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3c967-1347-4d7c-8aaf-7e440d076355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:51.486192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3c967-1347-4d7c-8aaf-7e440d076355 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.486464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3c967-1347-4d7c-8aaf-7e440d076355 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.486731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3c967-1347-4d7c-8aaf-7e440d076355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.498238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3c967-1347-4d7c-8aaf-7e440d076355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:51.499682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3c967-1347-4d7c-8aaf-7e440d076355 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-d0e3c967-1347-4d7c-8aaf-7e440d076355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:51.515221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:51.516191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:51.517155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:51.517155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:51.517155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:51.517155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 487/940] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:51.523293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:51.528800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a4c83-087c-46f9-8ba1-5d0b5a37001d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.529104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a4c83-087c-46f9-8ba1-5d0b5a37001d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.529376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a4c83-087c-46f9-8ba1-5d0b5a37001d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.530974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 488/941] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:51.537598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109521e-f640-4b73-97c1-eba0aabfccd4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.537880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109521e-f640-4b73-97c1-eba0aabfccd4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.538153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109521e-f640-4b73-97c1-eba0aabfccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.561359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c109521e-f640-4b73-97c1-eba0aabfccd4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:51.562738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c109521e-f640-4b73-97c1-eba0aabfccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:51.573710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:51.644604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 489/942] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:51.651449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918ecd-2d41-4a10-9924-0551b8a3924c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:51.687684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:51.688626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.689138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.689609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.690472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:51.690990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:51.692543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:51.705307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 454/943] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:51.714139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109521e-f640-4b73-97c1-eba0aabfccd4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:51.819840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109521e-f640-4b73-97c1-eba0aabfccd4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:51.862378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0b088-ed8c-460a-9a7f-37a67a4dde36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:51.863478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b088-ed8c-460a-9a7f-37a67a4dde36 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.863478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b088-ed8c-460a-9a7f-37a67a4dde36 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.863631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b088-ed8c-460a-9a7f-37a67a4dde36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.874636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b088-ed8c-460a-9a7f-37a67a4dde36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:51.876331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b088-ed8c-460a-9a7f-37a67a4dde36 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-56f0b088-ed8c-460a-9a7f-37a67a4dde36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:51.889252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:51.890130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:51.891000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:51.893309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 490/944] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:51.899517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:51.936322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:51.942568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5f3c-1e5d-4d8a-adbf-7ba748597a93 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.942864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5f3c-1e5d-4d8a-adbf-7ba748597a93 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.943147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5f3c-1e5d-4d8a-adbf-7ba748597a93 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.944810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 491/945] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:51.950918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef89e4-31e2-4c82-97ae-be1c7c76db7f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:51.951207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef89e4-31e2-4c82-97ae-be1c7c76db7f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:51.951483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef89e4-31e2-4c82-97ae-be1c7c76db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:51.960233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:51.971675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-80ef89e4-31e2-4c82-97ae-be1c7c76db7f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:51.972878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-80ef89e4-31e2-4c82-97ae-be1c7c76db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:52.015607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712cd18-393e-4cfa-a29e-440fd8bf877f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.049087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 492/946] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:52.049087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef89e4-31e2-4c82-97ae-be1c7c76db7f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.051814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.052488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.052770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.053058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.053769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:52.054075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.055596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.068175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 455/947] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:52.075436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.160443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef89e4-31e2-4c82-97ae-be1c7c76db7f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.176529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:52.184687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e7ba-e2fb-430f-b23c-0375ff2f0221 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.199230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.200080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.200560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.201002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.201873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.203525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.206357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING keystone.server.flask.common [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 21:19:52.209936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:52.222984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.223640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.223991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.224235 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ee17ca4bc9cc441b9be64129c7ebb212/roles/74b34a8549e54eb7a4946a63986fbbac` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.226971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=ee17ca4bc9cc441b9be64129c7ebb212, role_id=74b34a8549e54eb7a4946a63986fbbac)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.228480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.269702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.sql.core [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 21:19:52.269702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 21:19:52.269702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [parameters: {'id': '99de0d89013d42469be4e59f8beaedf4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 21:19:52.269702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81611) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 99de0d89013d42469be4e59f8beaedf4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 99de0d89013d42469be4e59f8beaedf4. Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 21:19:52.287062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 21:19:52.289929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application yield resource Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application next(self.gen) Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise self.value Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application session.commit() Sep 09 21:19:52.290955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.session.flush() Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application compat.raise_( Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 21:19:52.292359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 21:19:52.293828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application conn.query(q) Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application result.read() Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 21:19:52.296183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [parameters: {'id': '99de0d89013d42469be4e59f8beaedf4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:52.298310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:52.301639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 99de0d89013d42469be4e59f8beaedf4. Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 493/948] 10.222.0.60 () {60 vars in 1140 bytes} [Fri Sep 9 21:19:52 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:52.305097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.322029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 456/949] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:19:52 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/ee17ca4bc9cc441b9be64129c7ebb212/roles/74b34a8549e54eb7a4946a63986fbbac => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:19:52.325306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.422435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a00de-738a-4dfd-8a9f-e5cc39d18490 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.441193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef347b6-374a-4bf3-8837-43f0b6b72533 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.465394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.466722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.467191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.467929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.478398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.480707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f6c8e-1247-42d1-aab3-cb3f1efa9322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.480923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.481407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f6c8e-1247-42d1-aab3-cb3f1efa9322 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.481708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f6c8e-1247-42d1-aab3-cb3f1efa9322 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.481952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f6c8e-1247-42d1-aab3-cb3f1efa9322 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.482542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f6c8e-1247-42d1-aab3-cb3f1efa9322 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.484058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f6c8e-1247-42d1-aab3-cb3f1efa9322 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c93f6c8e-1247-42d1-aab3-cb3f1efa9322 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:52.494149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:52.495218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:52.496056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:52.498681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 457/950] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:52.499065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:52.499933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:52.500842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:52.501311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff10de-66bf-4b41-bf1c-c8a30e3453d1 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.501311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff10de-66bf-4b41-bf1c-c8a30e3453d1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.501311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff10de-66bf-4b41-bf1c-c8a30e3453d1 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.503308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 494/951] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:52.504151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.504712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 458/952] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:52.510887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff10de-66bf-4b41-bf1c-c8a30e3453d1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.531870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:52.565418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:52.622303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c5ad-dac7-4b6c-91d8-45bc074255b4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.625819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff10de-66bf-4b41-bf1c-c8a30e3453d1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.662335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d477c54-b66e-4bae-935f-72e2648ccdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.662955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477c54-b66e-4bae-935f-72e2648ccdaf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.663237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477c54-b66e-4bae-935f-72e2648ccdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.663476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.663587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477c54-b66e-4bae-935f-72e2648ccdaf None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.664133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d477c54-b66e-4bae-935f-72e2648ccdaf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:52.664334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.664426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d477c54-b66e-4bae-935f-72e2648ccdaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.664797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.665200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.665988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:52.666213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d477c54-b66e-4bae-935f-72e2648ccdaf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.666485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.668279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.681378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 495/953] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:52.681378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f11bfb-e6fb-4d3c-aea7-963ffc210266 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.681378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f11bfb-e6fb-4d3c-aea7-963ffc210266 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.681378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f11bfb-e6fb-4d3c-aea7-963ffc210266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.689309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 459/954] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:52.697182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.705370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-03f11bfb-e6fb-4d3c-aea7-963ffc210266 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:52.708002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-03f11bfb-e6fb-4d3c-aea7-963ffc210266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:52.797006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:52.802192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 496/955] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:52.823909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162be3-5878-4733-9b72-ca5d2d1bce54 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:52.872978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:52.873911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:52.874349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:52.874722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:52.875472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:52.875898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:52.877431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:52.883304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 460/956] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:52.889167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f11bfb-e6fb-4d3c-aea7-963ffc210266 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:52.938020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:52.996386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f11bfb-e6fb-4d3c-aea7-963ffc210266 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:53.031138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:53.031907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:53.032286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:53.032684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:53.033496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:53.034954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:53.101345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:53.111428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 497/957] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:19:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:19:53.229054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3a22-c6f5-46db-b821-d6bf9e7d893f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:53.275847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:53.276499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:53.276778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:53.277072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:53.277683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:53.279124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:53.288699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:53.290494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:53.291748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 461/958] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:53.299806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:53.406750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:53.410419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8a12-4c4e-47d9-b4c7-e164d9e72ea8 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:53.445524 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e243-4d23-4867-bf46-4e346461a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:53.446630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e243-4d23-4867-bf46-4e346461a73d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:53.447138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e243-4d23-4867-bf46-4e346461a73d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:53.447611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e243-4d23-4867-bf46-4e346461a73d None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:53.448438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e243-4d23-4867-bf46-4e346461a73d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:53.448953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e243-4d23-4867-bf46-4e346461a73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:53.450532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e243-4d23-4867-bf46-4e346461a73d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:53.455811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 498/959] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:53.461328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:53.464319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:53.570121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148f290-73fe-4903-92ff-3ce6c9410812 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:53.609675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d724c0-151f-4614-8e10-0c7656562d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:53.610280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d724c0-151f-4614-8e10-0c7656562d92 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:53.610556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d724c0-151f-4614-8e10-0c7656562d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:53.610822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d724c0-151f-4614-8e10-0c7656562d92 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:53.611442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d724c0-151f-4614-8e10-0c7656562d92 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:53.611795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d724c0-151f-4614-8e10-0c7656562d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:53.613186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d724c0-151f-4614-8e10-0c7656562d92 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:53.618620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 462/960] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:54.629500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac443b2-8516-4967-8447-df6c18232d8c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:54.630025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac443b2-8516-4967-8447-df6c18232d8c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:54.630025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac443b2-8516-4967-8447-df6c18232d8c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:54.631598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 499/961] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:54.637634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e469-10ae-48eb-acfa-80f32fe921e9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:54.638040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e469-10ae-48eb-acfa-80f32fe921e9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:54.638210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e469-10ae-48eb-acfa-80f32fe921e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:54.656906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8e43e469-10ae-48eb-acfa-80f32fe921e9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:54.658105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8e43e469-10ae-48eb-acfa-80f32fe921e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:54.718277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:54.733159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 463/962] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:55.011176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac443b2-8516-4967-8447-df6c18232d8c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.064965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6c3af-280e-4faf-b339-602105563430 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.065643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6c3af-280e-4faf-b339-602105563430 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.066122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6c3af-280e-4faf-b339-602105563430 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.067894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 464/963] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:55.073074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9839a73-6dc0-4387-b7b3-51e417186dbe None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.073589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9839a73-6dc0-4387-b7b3-51e417186dbe None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.074178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9839a73-6dc0-4387-b7b3-51e417186dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.093137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b9839a73-6dc0-4387-b7b3-51e417186dbe None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:55.094649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b9839a73-6dc0-4387-b7b3-51e417186dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:55.120354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac443b2-8516-4967-8447-df6c18232d8c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:55.161901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:55.162667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.162943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.163216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.175895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:19:55.176213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 465/964] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:19:55.179047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:55.179952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:19:55.181418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:55.185219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 500/965] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:55.187017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9839a73-6dc0-4387-b7b3-51e417186dbe None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.293897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9839a73-6dc0-4387-b7b3-51e417186dbe None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:55.321422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:55.330779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1db7-14ed-43be-bedf-b43ed17b762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:55.331600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1db7-14ed-43be-bedf-b43ed17b762e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.332051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1db7-14ed-43be-bedf-b43ed17b762e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.332493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1db7-14ed-43be-bedf-b43ed17b762e None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.333379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1db7-14ed-43be-bedf-b43ed17b762e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:55.333857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1db7-14ed-43be-bedf-b43ed17b762e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:55.335383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1db7-14ed-43be-bedf-b43ed17b762e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:55.345163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 466/966] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:55.351753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.379944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:55.387759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce1a18-0dbf-478f-8b12-81b765311474 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.388044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce1a18-0dbf-478f-8b12-81b765311474 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.388320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce1a18-0dbf-478f-8b12-81b765311474 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.394336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 467/967] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:19:55.395040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2784f-8c46-4a71-a72d-8005f7530890 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.395318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2784f-8c46-4a71-a72d-8005f7530890 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.395586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2784f-8c46-4a71-a72d-8005f7530890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.415061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8bd2784f-8c46-4a71-a72d-8005f7530890 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:55.416398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8bd2784f-8c46-4a71-a72d-8005f7530890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:55.464991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84466e5-74bc-441b-945d-070da7dedaa5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:55.502940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 468/968] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:55.503875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2784f-8c46-4a71-a72d-8005f7530890 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.510765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:55.512258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.512773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.513314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.528828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:55.531275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:55.556618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:55.557662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:55.558569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:55.558569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:55.558569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:55.561073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 501/969] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:55.568665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.619405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2784f-8c46-4a71-a72d-8005f7530890 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:55.638236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:55.660917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:55.661568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.661843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.662214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.662857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:55.665579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:55.668248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING keystone.server.flask.common [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 21:19:55.674980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:55.698255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada758d4-e378-4927-a1c4-c3a10927c473 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:55.711271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.sql.core [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 21:19:55.711271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 21:19:55.711271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [parameters: {'user_id': '14338b41cb4b4ea898d4f73f93a7f10b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 21:19:55.711271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Sep 09 21:19:55.722701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 21:19:55.723658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application yield resource Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application next(self.gen) Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise self.value Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application session.commit() Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 21:19:55.724613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.session.flush() Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application compat.raise_( Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 21:19:55.726172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 21:19:55.729617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application conn.query(q) Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application result.read() Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 21:19:55.739033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [parameters: {'user_id': '14338b41cb4b4ea898d4f73f93a7f10b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:55.739947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 21:19:55.740769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 469/970] 10.222.0.60 () {60 vars in 1131 bytes} [Fri Sep 9 21:19:55 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:55.741726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.753244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:55.754139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.754624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.755084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.755834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:55.756242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:55.757727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:55.772074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 502/971] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:55.778488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.864001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6e97-dd1f-45aa-8233-5aa6444a193d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:55.884898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0c3ea-7ca6-4c67-a4fd-9a8c476ff8d0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:55.898199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:55.898859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.899137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.899406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.906507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:55.908131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:55.918593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed0fdb-60d1-4d67-9a3f-1a144389eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:55.919216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed0fdb-60d1-4d67-9a3f-1a144389eec2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.919493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed0fdb-60d1-4d67-9a3f-1a144389eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.919762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed0fdb-60d1-4d67-9a3f-1a144389eec2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:55.925400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:55.926427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 470/972] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:55.927384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.928557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:55.933270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed0fdb-60d1-4d67-9a3f-1a144389eec2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:55.934705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed0fdb-60d1-4d67-9a3f-1a144389eec2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-19ed0fdb-60d1-4d67-9a3f-1a144389eec2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:19:55.946278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:55.948736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 503/973] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39451ca-9f48-4810-a723-2dc448869bd7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:55.949753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39451ca-9f48-4810-a723-2dc448869bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:55.950489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39451ca-9f48-4810-a723-2dc448869bd7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:55.953162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 504/974] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:55.953911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39451ca-9f48-4810-a723-2dc448869bd7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:55.969512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.028958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ac5bc-8033-4792-97e5-7e00af19f8ff None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.054859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39451ca-9f48-4810-a723-2dc448869bd7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.064996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.065647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.065928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.066197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.066778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.068162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:56.077236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:56.078462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:56.079534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 471/975] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:56.080549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.092875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810439a-7460-4e49-960f-958de578f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.093500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810439a-7460-4e49-960f-958de578f1ca None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.093775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810439a-7460-4e49-960f-958de578f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.094041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810439a-7460-4e49-960f-958de578f1ca None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.094724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810439a-7460-4e49-960f-958de578f1ca None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:56.095021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810439a-7460-4e49-960f-958de578f1ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.096676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810439a-7460-4e49-960f-958de578f1ca None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.131425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 505/976] 10.222.0.60 () {56 vars in 1101 bytes} [Fri Sep 9 21:19:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:56.132560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878103-f0c6-4eb9-8dc3-6edd3aeee5b0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.132839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878103-f0c6-4eb9-8dc3-6edd3aeee5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.133232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878103-f0c6-4eb9-8dc3-6edd3aeee5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.153422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ce878103-f0c6-4eb9-8dc3-6edd3aeee5b0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:56.154667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce878103-f0c6-4eb9-8dc3-6edd3aeee5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:56.201017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9138-4a63-4728-8db9-875c45b1669f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.204620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.215092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.234208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 506/977] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:56.238668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.239289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.239563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.239829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.240563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:56.240861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.242337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.246056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce878103-f0c6-4eb9-8dc3-6edd3aeee5b0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.267207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 472/978] 10.222.0.60 () {56 vars in 1149 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:56.274414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.388511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce878103-f0c6-4eb9-8dc3-6edd3aeee5b0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.396139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000c81d-830c-4033-bde8-55a2bfda6a04 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.433752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.434723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.435327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.435794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.436598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.436806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:56.437305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.437408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.437752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.438094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.439437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.448188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 507/979] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:56.454100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.470855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.508867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.510822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.514118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.563321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b940e-2706-4d38-88a9-6dd2d74671a9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.596681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.597317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.597757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.598039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.598981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:56.599437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.600791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.605752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 508/980] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:56.606502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.611622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 473/981] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:19:56.611622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.669794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.706895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01de49-a060-49bc-8e7d-9ff4dd05b3ee None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.707093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18579-7378-432c-a3b7-a8f2aa3add22 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.719465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.739756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.740354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.740633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.740903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.741568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.742536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.743616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.743745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.743890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.744160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.744858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] RBAC: Adding query filter params (interface=admin, service_id=5b18f81f13a14bfab7757f9256c2db2c, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:56.745196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.746541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.751512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 474/982] 10.222.0.60 () {56 vars in 1249 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/endpoints?service_id=5b18f81f13a14bfab7757f9256c2db2c&interface=admin®ion_id=RegionOne => generated 193 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:56.752281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.833386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 509/983] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:19:56 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:19:56.834410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.855202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01abb5-dd80-4731-9ce1-dda520665822 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.889056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:56.906960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.907609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.907884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.908149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.920779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.922213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:19:56.938649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:56.939670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:19:56.940555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:19:56.940555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:19:56.940555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:56.942471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 475/984] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:56.948404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:56.958310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5e0f1-b6a4-4cf9-9280-af07dd5e963b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:56.996721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:56.997436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:56.997712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:56.997999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:56.998611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:56.999960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:57.006363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 510/985] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:19:57.067068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3059-72b7-4213-93c9-bc584a17c2d6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:57.106326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:57.107046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:57.107388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:57.107722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:57.108443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:57.108812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:57.110300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:57.124296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 476/986] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:57.130315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:57.169018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:57.238008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577a59-f47d-4aaf-bde7-8c40d62ea567 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:57.272342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:57.273248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:57.273717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:57.274131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:57.281254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:57.282846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:19:57.294693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:57.295775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:19:57.296885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:57.298559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 511/987] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:57.304479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:57.340015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:57.411249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2178a0-f21b-4a2d-bf30-18ca3b27869f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:57.445931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b2e6d-74d0-4301-83e6-8347ba5f4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:57.446550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b2e6d-74d0-4301-83e6-8347ba5f4a67 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:57.446819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b2e6d-74d0-4301-83e6-8347ba5f4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:57.447087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b2e6d-74d0-4301-83e6-8347ba5f4a67 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:57.447775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b2e6d-74d0-4301-83e6-8347ba5f4a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:57.448073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b2e6d-74d0-4301-83e6-8347ba5f4a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:57.449548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b2e6d-74d0-4301-83e6-8347ba5f4a67 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:57.461801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 477/988] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:57.467547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:57.563600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:57.569742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a795d-0032-4084-8b39-c05b40ee684f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:57.606040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6bbf0-1149-4ba9-9fb0-e37ed7201756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:57.606728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bbf0-1149-4ba9-9fb0-e37ed7201756 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:57.607070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bbf0-1149-4ba9-9fb0-e37ed7201756 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:57.607403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bbf0-1149-4ba9-9fb0-e37ed7201756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:57.608184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6bbf0-1149-4ba9-9fb0-e37ed7201756 None admin] RBAC: Adding query filter params (role.id=74b34a8549e54eb7a4946a63986fbbac, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=ee17ca4bc9cc441b9be64129c7ebb212) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:57.608556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6bbf0-1149-4ba9-9fb0-e37ed7201756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:57.610069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6bbf0-1149-4ba9-9fb0-e37ed7201756 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:57.617184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 512/989] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:19:57 2022] GET /identity/v3/role_assignments?user.id=ee17ca4bc9cc441b9be64129c7ebb212&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=74b34a8549e54eb7a4946a63986fbbac => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:59.087722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d558a-94e1-42b7-a147-69d56969a64d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.088275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d558a-94e1-42b7-a147-69d56969a64d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.088275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d558a-94e1-42b7-a147-69d56969a64d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.089802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 478/990] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:59.094947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b5de-0e67-4a34-8a41-90feb15a7b90 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.095591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b5de-0e67-4a34-8a41-90feb15a7b90 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.095779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b5de-0e67-4a34-8a41-90feb15a7b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.113715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-28f2b5de-0e67-4a34-8a41-90feb15a7b90 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:59.114888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-28f2b5de-0e67-4a34-8a41-90feb15a7b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:59.162268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182335ff-a938-441c-8726-b7eea314576f None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.162584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182335ff-a938-441c-8726-b7eea314576f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.162822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182335ff-a938-441c-8726-b7eea314576f None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.164188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 479/991] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:59.169244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef811a0-cff8-45b0-99f5-ff6cf22e48e5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.169523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef811a0-cff8-45b0-99f5-ff6cf22e48e5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.169797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef811a0-cff8-45b0-99f5-ff6cf22e48e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.184715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 513/992] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:19:59.188998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0ef811a0-cff8-45b0-99f5-ff6cf22e48e5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:59.189569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0ef811a0-cff8-45b0-99f5-ff6cf22e48e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:59.259639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 480/993] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:19:59.458234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b5de-0e67-4a34-8a41-90feb15a7b90 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:59.524278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef811a0-cff8-45b0-99f5-ff6cf22e48e5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:59.549884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:59.552550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:59.562292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b5de-0e67-4a34-8a41-90feb15a7b90 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:59.598705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:59.599444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.599659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.599932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] PATH_INFO: `/v3/services/compute` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.600639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:59.602268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:59.611274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:59.612501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:19:59.613504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:19:59.619563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 514/994] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:19:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:19:59.620383 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:59.632272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef811a0-cff8-45b0-99f5-ff6cf22e48e5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:59.668869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:59.669557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.669840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.670110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.670708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:59.672118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:19:59.681653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:19:59.682737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:19:59.683579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 481/995] 10.222.0.60 () {56 vars in 1126 bytes} [Fri Sep 9 21:19:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:19:59.689015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:59.735086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5bd9-984a-48c3-98de-123e0e9319ee None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:59.769960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:59.770803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.771224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.771675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.772296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:59.772595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:59.774654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:59.783365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:59.784240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 515/996] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:59.785206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:59.798434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3ee9c-7e39-4ee2-b65b-34b13b378702 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:59.805857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:59.832161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3672814-6dd7-4271-a4c4-26371a5c91ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:59.835621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3672814-6dd7-4271-a4c4-26371a5c91ec None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.835621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3672814-6dd7-4271-a4c4-26371a5c91ec None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.835621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3672814-6dd7-4271-a4c4-26371a5c91ec None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.835621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3672814-6dd7-4271-a4c4-26371a5c91ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:59.835621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3672814-6dd7-4271-a4c4-26371a5c91ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:59.835621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3672814-6dd7-4271-a4c4-26371a5c91ec None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:59.841089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 482/997] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:59.842224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59546658-3cc7-4f6b-8655-d9a64494d6bb None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.842508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59546658-3cc7-4f6b-8655-d9a64494d6bb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.842775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59546658-3cc7-4f6b-8655-d9a64494d6bb None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.843957 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 483/998] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:19:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:19:59.847039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59546658-3cc7-4f6b-8655-d9a64494d6bb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:19:59.892348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498ed2-1efd-4514-8e5b-e0b3085569ec None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:59.924993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34afc12-afd5-4e65-bc98-3f23d5727dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:59.925622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afc12-afd5-4e65-bc98-3f23d5727dea None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.925909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afc12-afd5-4e65-bc98-3f23d5727dea None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.926182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afc12-afd5-4e65-bc98-3f23d5727dea None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.926805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34afc12-afd5-4e65-bc98-3f23d5727dea None admin] RBAC: Adding query filter params (type=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:59.927112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34afc12-afd5-4e65-bc98-3f23d5727dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:59.928478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34afc12-afd5-4e65-bc98-3f23d5727dea None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:59.934231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 516/999] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:19:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:19:59.935357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bc77-6d45-4f6a-8576-af358fa9baf9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.935649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bc77-6d45-4f6a-8576-af358fa9baf9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.935951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bc77-6d45-4f6a-8576-af358fa9baf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.950203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59546658-3cc7-4f6b-8655-d9a64494d6bb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:19:59.953526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0b05bc77-6d45-4f6a-8576-af358fa9baf9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:19:59.955835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0b05bc77-6d45-4f6a-8576-af358fa9baf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:19:59.982774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:19:59.983369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:19:59.983642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:19:59.983908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:19:59.984525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:19:59.984821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:19:59.986262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:19:59.991700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 484/1000] 10.222.0.60 () {56 vars in 1122 bytes} [Fri Sep 9 21:19:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:19:59.993001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:00.011424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:00.020652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 517/1001] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:19:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:00.021493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bc77-6d45-4f6a-8576-af358fa9baf9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:00.036370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:00.097114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab3c49-b4de-4aae-80f0-319d6b401e93 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:00.126072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bc77-6d45-4f6a-8576-af358fa9baf9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:00.132992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:00.133946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:00.134228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:00.134499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:00.135193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] RBAC: Adding query filter params (interface=public, service_id=ba8af5a7d620432f9a393e2ab317ddb7, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:00.135618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:00.137121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:00.142418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 485/1002] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:19:59 2022] GET /identity/v3/endpoints?service_id=ba8af5a7d620432f9a393e2ab317ddb7&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:00.147607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:00.168309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:00.168913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:00.169224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:00.169495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:00.170146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:00.171934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:00.228269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:00.247213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e936-781f-4bae-adb0-cd2ac1137fbe None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:00.257315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 518/1003] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:20:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:00.294020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:00.294672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:00.294925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:00.295193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:00.295799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:00.297226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:00.298683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:00.309243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 486/1004] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:20:00 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:20:00.381251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:00.418018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50651054-76b8-4993-89c6-d440f2c7b55b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:00.456361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:00.457223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:00.457553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:00.458554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] PATH_INFO: `/v3/services/image` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:00.459147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:00.460547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:00.471142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:00.472427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:00.473908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 519/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Sep 9 21:20:00 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:00.479251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:00.581810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630abc6-c256-4b40-9e7b-33d31dfe9872 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:00.615897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8309b1e-8368-413a-afa6-d2e28e850753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:00.616494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8309b1e-8368-413a-afa6-d2e28e850753 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:00.616769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8309b1e-8368-413a-afa6-d2e28e850753 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:00.617062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8309b1e-8368-413a-afa6-d2e28e850753 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:00.617731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8309b1e-8368-413a-afa6-d2e28e850753 None admin] RBAC: Adding query filter params (name=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:00.618031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8309b1e-8368-413a-afa6-d2e28e850753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:00.619382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8309b1e-8368-413a-afa6-d2e28e850753 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:00.628751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 487/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:00.630279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:00.732843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5c627-7515-4135-b24f-5e6d18ec985c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:00.765868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63729939-b149-4b8b-8966-62f9f8aa944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:00.766474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729939-b149-4b8b-8966-62f9f8aa944e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:00.766748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729939-b149-4b8b-8966-62f9f8aa944e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:00.767018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729939-b149-4b8b-8966-62f9f8aa944e None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:00.767640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63729939-b149-4b8b-8966-62f9f8aa944e None admin] RBAC: Adding query filter params (type=image) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:00.767941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63729939-b149-4b8b-8966-62f9f8aa944e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:00.769340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63729939-b149-4b8b-8966-62f9f8aa944e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:00.771372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:00.775215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 520/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:02.501653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5963e-ad04-4c49-bc0b-0516a55b5a49 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:02.502202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5963e-ad04-4c49-bc0b-0516a55b5a49 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:02.502202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5963e-ad04-4c49-bc0b-0516a55b5a49 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:02.502492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3b36-5d32-4c19-9ff2-bdea0e212c86 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:02.502862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3b36-5d32-4c19-9ff2-bdea0e212c86 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:02.503129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3b36-5d32-4c19-9ff2-bdea0e212c86 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:02.503681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 488/1008] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:02.504593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 521/1009] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:02.508850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296069b-061b-4d3d-9e5d-00a46854f667 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:02.509165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296069b-061b-4d3d-9e5d-00a46854f667 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:02.509442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296069b-061b-4d3d-9e5d-00a46854f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:02.509539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441d4cf-c536-4370-8938-7c199d40844f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:02.509815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441d4cf-c536-4370-8938-7c199d40844f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:02.510089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441d4cf-c536-4370-8938-7c199d40844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:02.516564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:02.527624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d296069b-061b-4d3d-9e5d-00a46854f667 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:02.528782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d296069b-061b-4d3d-9e5d-00a46854f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:02.529812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f441d4cf-c536-4370-8938-7c199d40844f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:02.531172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f441d4cf-c536-4370-8938-7c199d40844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:02.601295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 489/1010] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:02.613360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 522/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:20:02.867665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296069b-061b-4d3d-9e5d-00a46854f667 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:02.875390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441d4cf-c536-4370-8938-7c199d40844f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:02.973808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296069b-061b-4d3d-9e5d-00a46854f667 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:02.985841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441d4cf-c536-4370-8938-7c199d40844f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:03.008984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510bc2a-f513-4e94-9f5a-dfa712c5319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:03.009638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510bc2a-f513-4e94-9f5a-dfa712c5319b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.009918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510bc2a-f513-4e94-9f5a-dfa712c5319b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.010189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510bc2a-f513-4e94-9f5a-dfa712c5319b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.010775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510bc2a-f513-4e94-9f5a-dfa712c5319b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:03.012140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510bc2a-f513-4e94-9f5a-dfa712c5319b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:03.014034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:03.015167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:03.020586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:03.021245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.021527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a510bc2a-f513-4e94-9f5a-dfa712c5319b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:03.021624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:03.022663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 21:20:03.024081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:03.024829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.024902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 490/1012] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:20:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:03.024977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:03.024977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:03.029066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 523/1013] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:03.029066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:03.033143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1411-b4bf-43a0-a615-09797d16a010 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.033143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1411-b4bf-43a0-a615-09797d16a010 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.033143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1411-b4bf-43a0-a615-09797d16a010 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.033143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 491/1014] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:03.033143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1411-b4bf-43a0-a615-09797d16a010 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:03.128552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87fa2e-dc96-42ae-8228-ed52897cceba None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:03.135871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1411-b4bf-43a0-a615-09797d16a010 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:03.161275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30252b7d-4531-465b-9dbc-f9d635317c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:03.161875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252b7d-4531-465b-9dbc-f9d635317c72 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.162177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252b7d-4531-465b-9dbc-f9d635317c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.162448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30252b7d-4531-465b-9dbc-f9d635317c72 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.163062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30252b7d-4531-465b-9dbc-f9d635317c72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:03.163355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30252b7d-4531-465b-9dbc-f9d635317c72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:03.164814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30252b7d-4531-465b-9dbc-f9d635317c72 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:03.169615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 524/1015] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:20:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:03.169995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:03.170600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.170779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289bbe8-a0bd-46cc-beaa-df280dfeb1f4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.170951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.171064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289bbe8-a0bd-46cc-beaa-df280dfeb1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.171230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.171336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289bbe8-a0bd-46cc-beaa-df280dfeb1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.171873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:03.173313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:03.190348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b289bbe8-a0bd-46cc-beaa-df280dfeb1f4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:03.191555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b289bbe8-a0bd-46cc-beaa-df280dfeb1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:03.247198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:03.256974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 525/1016] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:03.257642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289bbe8-a0bd-46cc-beaa-df280dfeb1f4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:03.269463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 492/1017] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:20:03 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:03.366171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289bbe8-a0bd-46cc-beaa-df280dfeb1f4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:03.402680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:03.403213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.403488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.403754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.404386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:03.404680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:03.406091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:03.411578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 526/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Fri Sep 9 21:20:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:03.418200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:03.471179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:03.525539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f184546-1dfc-43e0-a91c-9b66ba550a7e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:03.531979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:03.561902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061dcc4-d1c2-4877-9170-3d1ea3bbfa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:03.562516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061dcc4-d1c2-4877-9170-3d1ea3bbfa9f None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.562819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061dcc4-d1c2-4877-9170-3d1ea3bbfa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.563084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061dcc4-d1c2-4877-9170-3d1ea3bbfa9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.563747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061dcc4-d1c2-4877-9170-3d1ea3bbfa9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:03.565139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061dcc4-d1c2-4877-9170-3d1ea3bbfa9f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:03.594648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:03.637097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 493/1019] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:20:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:03.640186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f86c-a7a4-41ad-b34f-1d126cd770a7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:03.685256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd44537-c817-47b3-a3fd-15718e141dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:03.685788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44537-c817-47b3-a3fd-15718e141dcc None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:03.686077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44537-c817-47b3-a3fd-15718e141dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:03.686350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44537-c817-47b3-a3fd-15718e141dcc None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:03.687010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd44537-c817-47b3-a3fd-15718e141dcc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:03.688399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd44537-c817-47b3-a3fd-15718e141dcc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:03.796192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 527/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:20:03 2022] POST /identity/v3/services => generated 242 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:05.471667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97442-b6ef-4d04-b414-a81ab0c8d5c6 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:05.472219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97442-b6ef-4d04-b414-a81ab0c8d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:05.472219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97442-b6ef-4d04-b414-a81ab0c8d5c6 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:05.473728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 494/1021] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:05.478896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836cf57-025f-4d56-94c5-2d1834aa3c13 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:05.479343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836cf57-025f-4d56-94c5-2d1834aa3c13 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:05.479432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836cf57-025f-4d56-94c5-2d1834aa3c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:05.497918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8836cf57-025f-4d56-94c5-2d1834aa3c13 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:05.499115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8836cf57-025f-4d56-94c5-2d1834aa3c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:05.574241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 528/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:05.839367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e97442-b6ef-4d04-b414-a81ab0c8d5c6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:05.909660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248eccc-4fd3-4252-9f10-270ce7d7b289 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:05.909945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248eccc-4fd3-4252-9f10-270ce7d7b289 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:05.910214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248eccc-4fd3-4252-9f10-270ce7d7b289 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:05.911677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 529/1023] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:20:05.916864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b0aa-29aa-4cbc-990f-f7aa5cca2838 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:05.917176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b0aa-29aa-4cbc-990f-f7aa5cca2838 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:05.917456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b0aa-29aa-4cbc-990f-f7aa5cca2838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:05.936603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2488b0aa-29aa-4cbc-990f-f7aa5cca2838 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:05.937802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2488b0aa-29aa-4cbc-990f-f7aa5cca2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:05.950702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e97442-b6ef-4d04-b414-a81ab0c8d5c6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:05.958488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:05.973362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:05.987624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432769e-dff9-4f23-988a-e967c81ab535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:05.988291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432769e-dff9-4f23-988a-e967c81ab535 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:05.988571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432769e-dff9-4f23-988a-e967c81ab535 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:05.988844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432769e-dff9-4f23-988a-e967c81ab535 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:05.989962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432769e-dff9-4f23-988a-e967c81ab535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:05.991388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432769e-dff9-4f23-988a-e967c81ab535 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:05.993910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 495/1024] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:05.995361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f8c08-998a-4520-95a9-afcbf3b12d15 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:05.996207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f8c08-998a-4520-95a9-afcbf3b12d15 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:05.996792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f8c08-998a-4520-95a9-afcbf3b12d15 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:05.998265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 496/1025] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:05.999030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f8c08-998a-4520-95a9-afcbf3b12d15 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.017612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 530/1026] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:20:06.019048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ddd39-211c-47be-8f8a-1d2d9a464547 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.020229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ddd39-211c-47be-8f8a-1d2d9a464547 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.020229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ddd39-211c-47be-8f8a-1d2d9a464547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.036859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8d2ddd39-211c-47be-8f8a-1d2d9a464547 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:06.038067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8d2ddd39-211c-47be-8f8a-1d2d9a464547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:06.110760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f8c08-998a-4520-95a9-afcbf3b12d15 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.113178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 531/1027] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:06.158351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.158957 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.159240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.159512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.160152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:06.161620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:06.258727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 497/1028] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:20:05 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:20:06.292126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ddd39-211c-47be-8f8a-1d2d9a464547 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.381524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.395099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:06.400182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ddd39-211c-47be-8f8a-1d2d9a464547 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.419211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:06.436042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.436693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.436968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.437266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.452673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:06.457441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:06.460240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:06.461748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 532/1029] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:06.466379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.498508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b01ce-d178-40ac-b8ae-4bed59669491 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.543398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.544038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.544456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.544730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] PATH_INFO: `/v3/services/image` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.546133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:06.547519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:06.557434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:06.558488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:06.560173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 498/1030] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:06.564271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.577686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf566aa-4eac-4e1c-b5ce-b2484b5e454a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.615636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.616252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.616580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.617349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.618047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:06.618329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:06.619724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:06.628038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 533/1031] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:06.634794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.658371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:06.669047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:06.675825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a61e-424e-4288-95e3-1d3f343c3366 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.711675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4058947-b214-48fb-b483-22889090e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.712616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4058947-b214-48fb-b483-22889090e71c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.713125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4058947-b214-48fb-b483-22889090e71c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.713397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4058947-b214-48fb-b483-22889090e71c None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.714034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4058947-b214-48fb-b483-22889090e71c None admin] RBAC: Adding query filter params (name=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:06.714333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4058947-b214-48fb-b483-22889090e71c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:06.715813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4058947-b214-48fb-b483-22889090e71c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:06.726535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 499/1032] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:06.727609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4058947-b214-48fb-b483-22889090e71c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.751893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3384-05cb-4179-83e7-bdcd519dd11b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.788341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.788998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.789302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.789655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.799978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:06.801638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:06.817282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:06.818476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:20:06.819581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:06.819581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:06.819581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:06.823977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 534/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:06.825335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.836845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4058947-b214-48fb-b483-22889090e71c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.881905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.883355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.883706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.884256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.885304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] RBAC: Adding query filter params (type=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:06.885561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:06.887084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:06.892531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 500/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:06.898082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:06.900874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:06.923850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:06.933171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4699c0-75e0-437a-ada4-efa6e0ad9580 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:06.969118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:06.969733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:06.970272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:06.970540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:06.971182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:06.971486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:06.972918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:06.989076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 535/1035] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:06.991156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:07.006840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203d5d-acfc-41ad-9b8c-e3d5e2c84c37 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:07.041801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:07.042410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:07.042683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:07.042950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:07.043644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] RBAC: Adding query filter params (interface=public, service_id=999a744fd0c94eb1befe4b7000a82c10, region_id=RegionOne) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:07.043946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:07.045336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:07.055867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 501/1036] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/endpoints?service_id=999a744fd0c94eb1befe4b7000a82c10&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:07.056747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:07.098617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e95b-1f0e-4b56-9aee-86a47d0c89b5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:07.131208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:07.146993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:07.146993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:07.146993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:07.146993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:07.147451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:07.147538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:07.148773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:20:07.160577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:07.161773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:20:07.162746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:07.163303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7209e7b-bc2a-4b09-a311-64e7fd4e01a3 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:07.165817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 536/1037] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:20:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:07.168380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:07.200398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:07.201010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:07.201322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:07.201593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:07.202193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:07.203560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:07.210231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 502/1038] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:20:07 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:20:07.278900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee520e8-4cc8-4f9e-a79d-628fa0c18bdc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:07.314645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:07.315260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:07.315536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:07.315807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:07.316538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:07.316846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:07.318306 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:07.343056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 537/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:07.344597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:07.451427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d26d5-e04e-40fd-a4f2-15403af25881 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:07.484700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:07.485332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:07.485613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:07.485885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:07.505175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:07.556155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:07.557760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:07.685559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 503/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:07 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:20:07.686841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:07.739522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:07.788277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20870b8b-1e04-4bd3-9dcd-5cc38ba39ddb None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:07.822106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:07.822727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:07.823003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:07.823273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:07.833555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:07.834967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:07.854578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:07.860511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:20:07.861585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:07.861585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:07.861585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:07.861585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 538/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:07.861825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:07.916346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:07.967090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a813-b780-4dfd-bc29-69a9c4f512ce None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:08.002871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:08.003469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:08.003748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:08.004019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:08.004708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:08.005013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:08.006458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:08.023812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 504/1042] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:08.025166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:08.127769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee662-9c33-4bd6-809c-19cb4b10d0e1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:08.129394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:08.169043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:08.169708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:08.169989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:08.170263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:08.176981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:08.178455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:20:08.189860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:08.190748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:08.196501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 539/1043] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:08.198186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:08.303386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee79f-9389-43c2-82fe-0dbf7a42bd07 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:08.314199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:08.338003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ceee8-85b7-4109-9d65-72d23782f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:08.338867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ceee8-85b7-4109-9d65-72d23782f71a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:08.339295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ceee8-85b7-4109-9d65-72d23782f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:08.339712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ceee8-85b7-4109-9d65-72d23782f71a None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:08.340544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ceee8-85b7-4109-9d65-72d23782f71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:08.340995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ceee8-85b7-4109-9d65-72d23782f71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:08.342920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ceee8-85b7-4109-9d65-72d23782f71a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:08.360696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 505/1044] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:08.362292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:08.472041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12781f4-9854-4890-bdb8-748009d3b5a0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:08.507846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8e74e-76bb-4ec7-8174-98e02ddb1ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:08.508517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e74e-76bb-4ec7-8174-98e02ddb1ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:08.508798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e74e-76bb-4ec7-8174-98e02ddb1ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:08.509092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e74e-76bb-4ec7-8174-98e02ddb1ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:08.509841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8e74e-76bb-4ec7-8174-98e02ddb1ab9 None admin] RBAC: Adding query filter params (role.id=74b34a8549e54eb7a4946a63986fbbac, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=97eb6832e7d246d6b6f1813763ac8a74) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:08.510150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8e74e-76bb-4ec7-8174-98e02ddb1ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:08.511560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8e74e-76bb-4ec7-8174-98e02ddb1ab9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:08.521380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 540/1045] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:08 2022] GET /identity/v3/role_assignments?user.id=97eb6832e7d246d6b6f1813763ac8a74&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=74b34a8549e54eb7a4946a63986fbbac => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:08.560771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88643a26-0645-4eba-afea-3e81dff6f9a0 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:08.561325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88643a26-0645-4eba-afea-3e81dff6f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:08.561325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88643a26-0645-4eba-afea-3e81dff6f9a0 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:08.562612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 506/1046] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:08.568449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13228-613a-49da-a36b-1948d46b491f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:08.568737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13228-613a-49da-a36b-1948d46b491f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:08.569014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13228-613a-49da-a36b-1948d46b491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:08.588754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e0f13228-613a-49da-a36b-1948d46b491f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:08.590018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0f13228-613a-49da-a36b-1948d46b491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:08.614144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:08.663900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 541/1047] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:08.928505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88643a26-0645-4eba-afea-3e81dff6f9a0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:09.081571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88643a26-0645-4eba-afea-3e81dff6f9a0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:09.115443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:09.116357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.117364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.117836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.128046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:09.133897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:09.134807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:09.135675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:09.138282 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 507/1048] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:09.143920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f13228-613a-49da-a36b-1948d46b491f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:09.245341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f13228-613a-49da-a36b-1948d46b491f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:09.279516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc4237-00b9-4974-9320-0dfa5a8b37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:09.280120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4237-00b9-4974-9320-0dfa5a8b37f1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.280395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4237-00b9-4974-9320-0dfa5a8b37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.280663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4237-00b9-4974-9320-0dfa5a8b37f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.281345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4237-00b9-4974-9320-0dfa5a8b37f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:09.281643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4237-00b9-4974-9320-0dfa5a8b37f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:09.282972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4237-00b9-4974-9320-0dfa5a8b37f1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:09.291162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 542/1049] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:09.296755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:09.330327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:09.405157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0a5bc-3a34-475d-8875-bfafbbf23d43 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:09.439691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:09.440317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.440591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.440860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] PATH_INFO: `/v3/users/84c78e52f2d0464ea3475dcb2c225761` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.446462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdee7-890c-438d-986c-a658307ea081 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.446755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdee7-890c-438d-986c-a658307ea081 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.447038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdee7-890c-438d-986c-a658307ea081 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.448378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 543/1050] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:09.453383 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e8bc-c122-4481-85e8-246463ea42bc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.453673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e8bc-c122-4481-85e8-246463ea42bc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.453961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e8bc-c122-4481-85e8-246463ea42bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.454765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] RBAC: Authorizing `identity:get_user(user_id=84c78e52f2d0464ea3475dcb2c225761)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:09.456199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:09.457988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 508/1051] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:09 2022] GET /identity/v3/users/84c78e52f2d0464ea3475dcb2c225761 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:09.463451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:09.472202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-60f8e8bc-c122-4481-85e8-246463ea42bc None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:09.473427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-60f8e8bc-c122-4481-85e8-246463ea42bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:09.488329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:09.541469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 544/1052] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:20:09.555949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:09.568072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd1730-d17f-4e4d-965c-4608f12fef98 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:09.602953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:09.603564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.603844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.604116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.672337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:09.673744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:09.758786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:09.771826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 509/1053] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:20:09.778186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e8bc-c122-4481-85e8-246463ea42bc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:09.814632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:09.886728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e8bc-c122-4481-85e8-246463ea42bc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:09.923875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:09.924414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.924690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.924957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.926178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f6862c6e5048349222e5f99c4db3c0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:09.927697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:09.929352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bd454-20a3-4d1a-8ccd-36cdf9a6d38e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:09.934681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 545/1054] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:09 2022] GET /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:09.935377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:09.953755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:09.970304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:09.970994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:09.971261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:09.971529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:09.972097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:09.973483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:09.982758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:09.983763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:09.984620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 510/1055] 10.222.0.60 () {56 vars in 1105 bytes} [Fri Sep 9 21:20:09 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:09.989582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:10.042101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:10.043410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0bf3-f9b8-47d9-8463-ecb20a1b59d1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:10.078803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:10.079769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:10.080229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:10.080675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:10.081644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=b0f6862c6e5048349222e5f99c4db3c0, user.id=84c78e52f2d0464ea3475dcb2c225761) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:10.082162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:10.083624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:10.089679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 546/1056] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:09 2022] GET /identity/v3/role_assignments?user.id=84c78e52f2d0464ea3475dcb2c225761&scope.project.id=b0f6862c6e5048349222e5f99c4db3c0&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:10.104547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3149c0-fd72-47c0-9512-d26cad8dabc1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:10.143000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:10.143633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:10.143914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:10.144187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:10.144836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] RBAC: Adding query filter params (name=image) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:10.145172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:10.146599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:10.153168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 511/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:10.158921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:10.248299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:10.268924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1643b-6dd6-4e5e-ad76-95ffcd0fa66c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:10.304310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e8db6-05f7-497e-801a-dc5194b7b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:10.305246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8db6-05f7-497e-801a-dc5194b7b1ba None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:10.305684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8db6-05f7-497e-801a-dc5194b7b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:10.306095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8db6-05f7-497e-801a-dc5194b7b1ba None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:10.306861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8db6-05f7-497e-801a-dc5194b7b1ba None admin] RBAC: Adding query filter params (type=image) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:10.307316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8db6-05f7-497e-801a-dc5194b7b1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:10.308800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8db6-05f7-497e-801a-dc5194b7b1ba None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:10.313978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 547/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:10.320424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:10.421928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3b724-3990-420f-9671-c398e92ade36 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:10.438325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:10.456436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72501e22-75ff-40cd-9d55-cd9387238c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:10.457057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501e22-75ff-40cd-9d55-cd9387238c94 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:10.457360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501e22-75ff-40cd-9d55-cd9387238c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:10.457627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501e22-75ff-40cd-9d55-cd9387238c94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:10.458295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72501e22-75ff-40cd-9d55-cd9387238c94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:10.459645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72501e22-75ff-40cd-9d55-cd9387238c94 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:10.544131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 512/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:20:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:10.687621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8501-3c76-4c70-9f63-726fb84ad4fd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:10.687904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8501-3c76-4c70-9f63-726fb84ad4fd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:10.688184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8501-3c76-4c70-9f63-726fb84ad4fd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:10.689571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 548/1060] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:10.695891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aada8-4e73-415e-a2ab-45a46fd4e105 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:10.696568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aada8-4e73-415e-a2ab-45a46fd4e105 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:10.696568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aada8-4e73-415e-a2ab-45a46fd4e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:10.715124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-128aada8-4e73-415e-a2ab-45a46fd4e105 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:10.716314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-128aada8-4e73-415e-a2ab-45a46fd4e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:10.793936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 513/1061] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:11.067213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8501-3c76-4c70-9f63-726fb84ad4fd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:11.170107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8501-3c76-4c70-9f63-726fb84ad4fd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:11.203062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:11.203688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:11.203965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:11.204234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:11.215086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:11.220055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:11.220969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:20:11.222154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:11.225186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 549/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Sep 9 21:20:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:11.227806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aada8-4e73-415e-a2ab-45a46fd4e105 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:11.329286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:11.333061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aada8-4e73-415e-a2ab-45a46fd4e105 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:11.368595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:11.369233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:11.369512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:11.369781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:11.370443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:11.370744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:11.372146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:11.380353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 514/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Sep 9 21:20:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:11.386012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:11.390438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:11.489267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c6e2-70fe-4383-b1d1-30e650674d4e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:11.522420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:11.523749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:11.524110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:11.524384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:11.534157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:11.535581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:11.550245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:11.551231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:20:11.552209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:11.552209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:11.552209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:11.552943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 550/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:11.557566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:11.669292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f78d-b3a0-41aa-a7de-3740d2b0874d None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:11.704113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:11.704757 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:11.704986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:11.705287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:11.705924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:11.706226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:11.707583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:11.725333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 515/1065] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:11.726630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:11.792792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:11.839116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056fcd-cbea-47ca-a80e-14b432219531 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:11.879645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:11.880277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:11.880553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:11.880820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:11.889405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:11.890813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:20:11.901932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:11.902912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:20:11.903878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:11.905338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 551/1066] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:20:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:11.908743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:11.931893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:12.011072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1ea61-3c96-4bb6-9640-3ee74bdf6130 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:12.044279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:12.044817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.045115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.045388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.046105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:12.046409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:12.047829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:12.065383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 516/1067] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:20:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:12.071534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:12.174946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf29ae6-8858-4a89-8f8d-2e74de3da77a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:12.193268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:12.211755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3184518-c8af-44d8-a00e-f1b6dde42eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:12.212391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3184518-c8af-44d8-a00e-f1b6dde42eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.212671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3184518-c8af-44d8-a00e-f1b6dde42eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.212943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3184518-c8af-44d8-a00e-f1b6dde42eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.224348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3184518-c8af-44d8-a00e-f1b6dde42eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:12.225817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3184518-c8af-44d8-a00e-f1b6dde42eb2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f3184518-c8af-44d8-a00e-f1b6dde42eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:12.243151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:12.244281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:20:12.245275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:12.245275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:12.245275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:12.251019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 552/1068] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:12.251176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:12.278059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee57e3-8bfb-49d9-87cb-f23d1cbf705e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.278410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee57e3-8bfb-49d9-87cb-f23d1cbf705e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.278658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee57e3-8bfb-49d9-87cb-f23d1cbf705e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.280082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 553/1069] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:20:12.285281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87075-9ee2-4865-b14e-1c40ae60fffa None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.285564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87075-9ee2-4865-b14e-1c40ae60fffa None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.285844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87075-9ee2-4865-b14e-1c40ae60fffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.304960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-adb87075-9ee2-4865-b14e-1c40ae60fffa None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:12.306290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-adb87075-9ee2-4865-b14e-1c40ae60fffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:12.339293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:12.364616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c27bf2-eac7-4f1d-bb87-8a61955062b4 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:12.381504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 554/1070] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:20:12.403272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:12.403881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.404154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.404419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.405132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:12.405433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:12.406843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:12.419908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 517/1071] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:12.426326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87075-9ee2-4865-b14e-1c40ae60fffa None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:12.525086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:12.529194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87075-9ee2-4865-b14e-1c40ae60fffa None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:12.561754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:12.562305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.562582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.562849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.571162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:12.572611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:20:12.583729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:12.584625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:20:12.586322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:12.589361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 555/1072] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:12.591127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:12.656287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:12.704388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756473-af8b-4250-b8bd-e47250005c85 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:12.739623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b788-13ac-4a22-9782-ea1dd0431158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:12.740232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b788-13ac-4a22-9782-ea1dd0431158 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.740517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b788-13ac-4a22-9782-ea1dd0431158 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.740781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b788-13ac-4a22-9782-ea1dd0431158 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.742095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b788-13ac-4a22-9782-ea1dd0431158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:12.742400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b788-13ac-4a22-9782-ea1dd0431158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:12.743827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b788-13ac-4a22-9782-ea1dd0431158 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:12.751602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:12.762133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 518/1073] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:12.762133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525823-f666-4da5-adf2-36fd43a3080c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.762133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525823-f666-4da5-adf2-36fd43a3080c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.762133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525823-f666-4da5-adf2-36fd43a3080c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.762133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 519/1074] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:12.765071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525823-f666-4da5-adf2-36fd43a3080c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:12.768016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2d07-1f00-4acb-b90d-bcf18a968835 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:12.800541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2b256-d75e-49fc-8534-0352a4e3445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:12.801192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2b256-d75e-49fc-8534-0352a4e3445d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.801468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2b256-d75e-49fc-8534-0352a4e3445d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.801734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2b256-d75e-49fc-8534-0352a4e3445d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.812321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2b256-d75e-49fc-8534-0352a4e3445d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-00a2b256-d75e-49fc-8534-0352a4e3445d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:12.817423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:12.818496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 556/1075] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:20:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:12.822066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a0b32-7399-4ce9-ac32-9b7b319980ef None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.822870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a0b32-7399-4ce9-ac32-9b7b319980ef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.822870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a0b32-7399-4ce9-ac32-9b7b319980ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.837981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-959a0b32-7399-4ce9-ac32-9b7b319980ef None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:12.839160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-959a0b32-7399-4ce9-ac32-9b7b319980ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:12.853011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:12.870385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525823-f666-4da5-adf2-36fd43a3080c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:12.904327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:12.904981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:12.905289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:12.905561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/97eb6832e7d246d6b6f1813763ac8a74/roles/74b34a8549e54eb7a4946a63986fbbac` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:12.907453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 557/1076] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:12.907703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=97eb6832e7d246d6b6f1813763ac8a74, role_id=74b34a8549e54eb7a4946a63986fbbac)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:12.908275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a0b32-7399-4ce9-ac32-9b7b319980ef None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:12.909193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:12.960035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 520/1077] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:20:12 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/97eb6832e7d246d6b6f1813763ac8a74/roles/74b34a8549e54eb7a4946a63986fbbac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:20:13.015733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a0b32-7399-4ce9-ac32-9b7b319980ef None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:13.052810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:13.053465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:13.053743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:13.054130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:13.055242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:13.055542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:13.056931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:13.071418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 558/1078] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:20:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:13.072196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:13.138612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:13.181548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685915e-bd20-418c-a363-8c05354b37c9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:13.190139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:13.203689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:13.219023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:13.219918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:13.220202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:13.220478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] PATH_INFO: `/v3/users/84c78e52f2d0464ea3475dcb2c225761` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:13.221632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] RBAC: Authorizing `identity:get_user(user_id=84c78e52f2d0464ea3475dcb2c225761)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:13.223067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:13.224932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 521/1079] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:13 2022] GET /identity/v3/users/84c78e52f2d0464ea3475dcb2c225761 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:13.230944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:13.302705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b028a5f-c8f4-4f7b-9d4e-55f0c317320e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:13.332566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c9a70-c750-49c3-888b-9cd7e329297a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:13.345458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:13.346388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:13.346671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:13.347100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:13.361927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:13.371642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:13.376572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:13.376572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:13.376572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:13.376572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f6862c6e5048349222e5f99c4db3c0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:13.376572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:13.377430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 522/1080] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:13 2022] GET /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:13.383608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:13.425222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:13.426666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:13.439826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:13.490163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14bb17-2f01-45c3-8223-741747e18a25 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:13.525232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:13.525890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:13.526165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:13.526434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0/users/84c78e52f2d0464ea3475dcb2c225761/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:13.528314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f6862c6e5048349222e5f99c4db3c0, user_id=84c78e52f2d0464ea3475dcb2c225761, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:13.529769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:13.536458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 559/1081] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:20:13.542247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:13.595088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 523/1082] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:20:13 2022] PUT /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0/users/84c78e52f2d0464ea3475dcb2c225761/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:20:13.648149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac258841-4de4-419e-827f-68dc7b6d9fc2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:13.661363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:13.687335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d3d37-ce06-4109-84f2-92688bd4de47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:13.687996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d3d37-ce06-4109-84f2-92688bd4de47 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:13.688278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d3d37-ce06-4109-84f2-92688bd4de47 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:13.688552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d3d37-ce06-4109-84f2-92688bd4de47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:13.701527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d3d37-ce06-4109-84f2-92688bd4de47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:13.703058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d3d37-ce06-4109-84f2-92688bd4de47 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ef4d3d37-ce06-4109-84f2-92688bd4de47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:13.719966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:13.721001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:20:13.721959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:13.721959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:13.721959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:13.726768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 560/1083] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:13.728148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:13.792488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:13.837930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb18b-7cec-49dd-abd4-6f510ed6003c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:13.881601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e8e53-d76c-48fb-8f28-adb56628a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:13.882785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8e53-d76c-48fb-8f28-adb56628a270 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:13.883053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8e53-d76c-48fb-8f28-adb56628a270 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:13.883320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8e53-d76c-48fb-8f28-adb56628a270 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:13.883962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e8e53-d76c-48fb-8f28-adb56628a270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:13.884263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e8e53-d76c-48fb-8f28-adb56628a270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:13.885649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e8e53-d76c-48fb-8f28-adb56628a270 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:13.899502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 524/1084] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:15.150616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d2986-86b8-4b8a-83fe-10c2b41a6970 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:15.151129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d2986-86b8-4b8a-83fe-10c2b41a6970 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:15.151129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d2986-86b8-4b8a-83fe-10c2b41a6970 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:15.152424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 561/1085] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:15.157796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e3ec-28b3-4490-97e6-a62a8bf72fba None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:15.158189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e3ec-28b3-4490-97e6-a62a8bf72fba None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:15.158332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e3ec-28b3-4490-97e6-a62a8bf72fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:15.176254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-15f6e3ec-28b3-4490-97e6-a62a8bf72fba None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:15.177439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-15f6e3ec-28b3-4490-97e6-a62a8bf72fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:15.241748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 525/1086] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:15.508187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d2986-86b8-4b8a-83fe-10c2b41a6970 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:15.606652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d2986-86b8-4b8a-83fe-10c2b41a6970 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:15.639988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3320e-c1a3-4ed5-bd1d-ffe30d20be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:15.640646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3320e-c1a3-4ed5-bd1d-ffe30d20be1a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:15.640924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3320e-c1a3-4ed5-bd1d-ffe30d20be1a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:15.641216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3320e-c1a3-4ed5-bd1d-ffe30d20be1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:15.653324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3320e-c1a3-4ed5-bd1d-ffe30d20be1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-4ca3320e-c1a3-4ed5-bd1d-ffe30d20be1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:15.658243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:15.659461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:15.660324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 562/1087] 10.222.0.60 () {56 vars in 1120 bytes} [Fri Sep 9 21:20:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:15.665953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6e3ec-28b3-4490-97e6-a62a8bf72fba None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:15.710939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:15.762674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22abe53-5669-4735-acb6-6187cafd5f02 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:15.762854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22abe53-5669-4735-acb6-6187cafd5f02 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:15.763138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22abe53-5669-4735-acb6-6187cafd5f02 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:15.765001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 563/1088] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:20:15.765166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6e3ec-28b3-4490-97e6-a62a8bf72fba None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:15.769933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc38b84-7915-43cf-9f5c-af73eb10547b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:15.770214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc38b84-7915-43cf-9f5c-af73eb10547b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:15.770483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc38b84-7915-43cf-9f5c-af73eb10547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:15.787832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5fc38b84-7915-43cf-9f5c-af73eb10547b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:15.789016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5fc38b84-7915-43cf-9f5c-af73eb10547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:15.798283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:15.798890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:15.799172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:15.799443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:15.800098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:15.800396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:15.801783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:15.805425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:15.810039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 526/1089] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Sep 9 21:20:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:15.815790 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:15.856351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 564/1090] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:20:15.917538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93298a-0e4a-423e-964c-c7c12e1069fa None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:15.924103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:15.950230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:15.950847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:15.951119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:15.951385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:15.962413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:15.963852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:15.978072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:15.979021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:20:15.980255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:15.980255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:15.980255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:15.980255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 527/1091] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:15.984932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc38b84-7915-43cf-9f5c-af73eb10547b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.081958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc38b84-7915-43cf-9f5c-af73eb10547b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.114649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.115246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.115523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.115794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.116427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:16.116724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.118116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.126471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.129094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 565/1092] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:16.135200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.150084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.231505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dca79f-ad19-490c-86eb-9682fc3de241 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.236202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8830-ce62-41d1-93ad-6d5d51c916b9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.264930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.265579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.265860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.266148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.269508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.270122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.270435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.270703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.277270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:16.278283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.280009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:16.281952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:16.282987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:16.283870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 528/1093] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:16.288976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:20:16.291413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:16.292519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:16.293738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 566/1094] 10.222.0.60 () {56 vars in 1093 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:16.298191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.311252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.367218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.391831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89f1e0-47fd-41d7-8149-4371ab256dc9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.397516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0bd9a-4c16-4cb3-8cdd-db9ef5d64cf9 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.426794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.427397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.427676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.427950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.428598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:16.429529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.430135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.430732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.431005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.431107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.431267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.431976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:16.432276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.433705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.438928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 529/1095] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:16.445329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.456288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 567/1096] 10.222.0.60 () {56 vars in 1133 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:16.462499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.524066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.543717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b888-3468-40dc-800b-d765e7afb4ba None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.563442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdbd62-045c-4dd1-807a-a2c523e70343 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.576562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.577219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.577494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.577768 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] PATH_INFO: `/v3/users/84c78e52f2d0464ea3475dcb2c225761` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.578873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] RBAC: Authorizing `identity:get_user(user_id=84c78e52f2d0464ea3475dcb2c225761)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.580288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.582081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 530/1097] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/users/84c78e52f2d0464ea3475dcb2c225761 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:16.587960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.591740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.597669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.603633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.603633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.603633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.666923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.668298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.686592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c9b7-e853-4cf7-8c5d-f24c3004149b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.721567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.722164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.722437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.722710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.739708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.766732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 568/1098] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:20:16.773466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.792233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.793723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.803700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.875837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb22c-0655-4be2-b671-c5c1923d7d08 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:16.893491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 531/1099] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:20:16.899825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.911380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:16.912007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:16.912305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:16.912580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:16.923854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:16.924559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:16.939420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:16.940438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:20:16.941601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:16.941601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:20:16.941601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:16.941601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 569/1100] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:20:16.946339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:16.947326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:16.996109 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b9275-e53d-4d9e-8c06-3e12c40fca29 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:17.029332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:17.030233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:17.030852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:17.031134 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:17.031392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:17.032485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f6862c6e5048349222e5f99c4db3c0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:17.033919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:17.035736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 532/1101] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:17.042286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:17.047310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594932-ea8b-4cf3-9671-44d638f2f5e0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:17.082193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:17.082796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:17.083076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:17.083351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:17.083995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:17.084298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:17.086704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:17.098063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 570/1102] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:17.103614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:17.141662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c8c8-aa0c-416f-a49d-482870b197b9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:17.157517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:17.175760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:17.175985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:17.176162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:17.176433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:17.177198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=b0f6862c6e5048349222e5f99c4db3c0, user.id=84c78e52f2d0464ea3475dcb2c225761) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:17.177505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:17.179999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:17.185657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 533/1103] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:17 2022] GET /identity/v3/role_assignments?user.id=84c78e52f2d0464ea3475dcb2c225761&scope.project.id=b0f6862c6e5048349222e5f99c4db3c0&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:17.202503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70455b-f1da-4e55-9147-9bd453661fbc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:17.240847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:17.242282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:17.242647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:17.242930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:17.250672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:17.252137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:20:17.265079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:17.266251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:17.267640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 571/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:17.272277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:17.379774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a2bbd-77ba-4763-8022-8a56f0dbe7ca None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:17.413514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c657796-89bd-45d9-a7f0-0281d94b2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:17.414133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c657796-89bd-45d9-a7f0-0281d94b2058 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:17.414416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c657796-89bd-45d9-a7f0-0281d94b2058 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:17.414690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c657796-89bd-45d9-a7f0-0281d94b2058 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:17.415386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c657796-89bd-45d9-a7f0-0281d94b2058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:17.415693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c657796-89bd-45d9-a7f0-0281d94b2058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:17.417156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c657796-89bd-45d9-a7f0-0281d94b2058 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:17.429677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 534/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:17.435744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:17.438676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:17.542758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9617c3-4fbf-4504-9c5a-2e21e9975736 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:17.575705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b5786-908e-4723-a1a5-9ec659476696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:17.576304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5786-908e-4723-a1a5-9ec659476696 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:17.576582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5786-908e-4723-a1a5-9ec659476696 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:17.576854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5786-908e-4723-a1a5-9ec659476696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:17.577601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5786-908e-4723-a1a5-9ec659476696 None admin] RBAC: Adding query filter params (role.id=74b34a8549e54eb7a4946a63986fbbac, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=97eb6832e7d246d6b6f1813763ac8a74) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:17.577910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5786-908e-4723-a1a5-9ec659476696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:17.579316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5786-908e-4723-a1a5-9ec659476696 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:17.585200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 572/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:17 2022] GET /identity/v3/role_assignments?user.id=97eb6832e7d246d6b6f1813763ac8a74&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=74b34a8549e54eb7a4946a63986fbbac => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:19.367229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038b7f-44d2-47e9-ae53-3b95bd77bba0 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:19.367751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038b7f-44d2-47e9-ae53-3b95bd77bba0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:19.367751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038b7f-44d2-47e9-ae53-3b95bd77bba0 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:19.369209 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 535/1107] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:20:19.374212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9bbe-10db-435f-814b-fa34dfaf64fd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:19.374585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9bbe-10db-435f-814b-fa34dfaf64fd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:19.374767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9bbe-10db-435f-814b-fa34dfaf64fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:19.392965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c5ba9bbe-10db-435f-814b-fa34dfaf64fd None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:19.394196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c5ba9bbe-10db-435f-814b-fa34dfaf64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:19.450943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:19.457992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 573/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:19.724554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038b7f-44d2-47e9-ae53-3b95bd77bba0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:19.766260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:19.823034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038b7f-44d2-47e9-ae53-3b95bd77bba0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:19.856304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d20472-311a-4896-b0a9-76ae0e9d94ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:19.856932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20472-311a-4896-b0a9-76ae0e9d94ab None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:19.857233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20472-311a-4896-b0a9-76ae0e9d94ab None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:19.857504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20472-311a-4896-b0a9-76ae0e9d94ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:19.858606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d20472-311a-4896-b0a9-76ae0e9d94ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:19.860037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d20472-311a-4896-b0a9-76ae0e9d94ab None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:19.861630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 536/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:19.867450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9bbe-10db-435f-814b-fa34dfaf64fd None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:19.963640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9bbe-10db-435f-814b-fa34dfaf64fd None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:19.997172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcef2e-40ae-468a-8c10-e4067aa971a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:19.997703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcef2e-40ae-468a-8c10-e4067aa971a7 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:19.997980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcef2e-40ae-468a-8c10-e4067aa971a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:19.998250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcef2e-40ae-468a-8c10-e4067aa971a7 None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:19.998893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcef2e-40ae-468a-8c10-e4067aa971a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:20.000304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcef2e-40ae-468a-8c10-e4067aa971a7 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:20.119885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 574/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:20:19 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:22.273872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fb8f-8918-4c8d-8d7f-b27a53e3ce22 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:22.274512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fb8f-8918-4c8d-8d7f-b27a53e3ce22 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:22.274512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34fb8f-8918-4c8d-8d7f-b27a53e3ce22 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:22.275736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 537/1111] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:22.281078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2143d-2f7f-49ef-9aad-47861af6e16b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:22.281474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2143d-2f7f-49ef-9aad-47861af6e16b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:22.281700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2143d-2f7f-49ef-9aad-47861af6e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:22.299855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1ac2143d-2f7f-49ef-9aad-47861af6e16b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:22.301055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1ac2143d-2f7f-49ef-9aad-47861af6e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:22.347669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:22.366746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 575/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:22.637531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34fb8f-8918-4c8d-8d7f-b27a53e3ce22 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:22.736403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34fb8f-8918-4c8d-8d7f-b27a53e3ce22 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:22.745319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:22.771061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:22.771920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:22.772845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:22.773241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] PATH_INFO: `/v3/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:22.774699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] RBAC: Authorizing `identity:get_role(role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:22.776104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:22.777463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 538/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:22 2022] GET /identity/v3/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:22.783401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2143d-2f7f-49ef-9aad-47861af6e16b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:22.878106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2143d-2f7f-49ef-9aad-47861af6e16b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:22.911666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:22.912219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:22.912494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:22.914020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] PATH_INFO: `/v3/users/1a2028783bbd4cc3af86182b434feb51` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:22.927284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] RBAC: Authorizing `identity:get_user(user_id=1a2028783bbd4cc3af86182b434feb51)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:22.928732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:22.930505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 576/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:22 2022] GET /identity/v3/users/1a2028783bbd4cc3af86182b434feb51 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:22.936512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:23.037769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae22f-80e5-4141-af92-c6ab97cef37b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:23.071011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:23.071609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:23.071884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:23.072155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:23.114981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:23.137281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:23.138716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:23.231738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 539/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:20:23.237941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:23.280188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:23.336917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dea1cb-a268-45a1-9645-e2b40d2cd803 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:23.369838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8b76c-8b81-4c7c-bcae-afb03ba261a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:23.370452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b76c-8b81-4c7c-bcae-afb03ba261a0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:23.370727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b76c-8b81-4c7c-bcae-afb03ba261a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:23.370997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b76c-8b81-4c7c-bcae-afb03ba261a0 None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:23.372086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8b76c-8b81-4c7c-bcae-afb03ba261a0 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f6862c6e5048349222e5f99c4db3c0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:23.373519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8b76c-8b81-4c7c-bcae-afb03ba261a0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:23.375110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 577/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:23 2022] GET /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:23.381545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:23.456077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:23.478545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ebc45-1fe0-4870-a1e1-29eca9523f08 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:23.511746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487737b-2a41-48f6-9415-376099ae4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:23.512271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487737b-2a41-48f6-9415-376099ae4d5e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:23.512545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487737b-2a41-48f6-9415-376099ae4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:23.512813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487737b-2a41-48f6-9415-376099ae4d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:23.513556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487737b-2a41-48f6-9415-376099ae4d5e None admin] RBAC: Adding query filter params (role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=b0f6862c6e5048349222e5f99c4db3c0, user.id=1a2028783bbd4cc3af86182b434feb51) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:23.513860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487737b-2a41-48f6-9415-376099ae4d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:23.515269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487737b-2a41-48f6-9415-376099ae4d5e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:23.520390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 540/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:23 2022] GET /identity/v3/role_assignments?user.id=1a2028783bbd4cc3af86182b434feb51&scope.project.id=b0f6862c6e5048349222e5f99c4db3c0&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:25.633806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8c84-d292-486d-89f4-989aec9f6287 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:25.634376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8c84-d292-486d-89f4-989aec9f6287 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:25.634376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8c84-d292-486d-89f4-989aec9f6287 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:25.635700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 578/1118] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:25.640776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1f22-2f98-4204-bc81-f9489e961b73 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:25.641243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1f22-2f98-4204-bc81-f9489e961b73 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:25.641424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1f22-2f98-4204-bc81-f9489e961b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:25.659725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d9dc1f22-2f98-4204-bc81-f9489e961b73 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:25.660910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d9dc1f22-2f98-4204-bc81-f9489e961b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:25.727864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 541/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:25.998701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8c84-d292-486d-89f4-989aec9f6287 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:26.096002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8c84-d292-486d-89f4-989aec9f6287 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:26.104913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:26.128409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:26.129648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:26.129648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:26.129648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] PATH_INFO: `/v3/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:26.131025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] RBAC: Authorizing `identity:get_role(role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:26.132940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:26.134265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 579/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:25 2022] GET /identity/v3/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:26.139964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1f22-2f98-4204-bc81-f9489e961b73 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:26.205164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:26.234260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1f22-2f98-4204-bc81-f9489e961b73 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:26.267532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:26.268106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:26.268380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:26.268646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] PATH_INFO: `/v3/users/1a2028783bbd4cc3af86182b434feb51` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:26.269754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] RBAC: Authorizing `identity:get_user(user_id=1a2028783bbd4cc3af86182b434feb51)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:26.271163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:26.272828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 542/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:26 2022] GET /identity/v3/users/1a2028783bbd4cc3af86182b434feb51 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:26.278514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:26.375724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86162e-5638-49ca-b039-40313efdef20 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:26.408986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedbd0e-d899-4159-b05f-9eaa32809fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:26.409631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbd0e-d899-4159-b05f-9eaa32809fbf None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:26.409912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbd0e-d899-4159-b05f-9eaa32809fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:26.410188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedbd0e-d899-4159-b05f-9eaa32809fbf None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:26.411291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedbd0e-d899-4159-b05f-9eaa32809fbf None admin] RBAC: Authorizing `identity:get_project(project_id=b0f6862c6e5048349222e5f99c4db3c0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:26.412825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedbd0e-d899-4159-b05f-9eaa32809fbf None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:26.414615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 580/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:26 2022] GET /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:26.420476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:26.516231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80d74-577d-4db9-a4bb-c01e9698286b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:26.548847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5087aa-b850-47af-8f37-81e1944a3c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:26.549459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5087aa-b850-47af-8f37-81e1944a3c0d None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:26.549739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5087aa-b850-47af-8f37-81e1944a3c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:26.550046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5087aa-b850-47af-8f37-81e1944a3c0d None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0/users/1a2028783bbd4cc3af86182b434feb51/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:26.552125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5087aa-b850-47af-8f37-81e1944a3c0d None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f6862c6e5048349222e5f99c4db3c0, user_id=1a2028783bbd4cc3af86182b434feb51, role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:26.554219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5087aa-b850-47af-8f37-81e1944a3c0d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:26.622448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:26.627407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 543/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:20:26 2022] PUT /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0/users/1a2028783bbd4cc3af86182b434feb51/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:20:28.745140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5ff8-05b6-444b-a67c-0d4a2bd8975c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:28.745668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5ff8-05b6-444b-a67c-0d4a2bd8975c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:28.745668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5ff8-05b6-444b-a67c-0d4a2bd8975c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:28.747012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 581/1124] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:28.752179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8b85-42a2-4b0c-af4a-b61817e000f5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:28.752594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8b85-42a2-4b0c-af4a-b61817e000f5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:28.752723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa8b85-42a2-4b0c-af4a-b61817e000f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:28.770297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-30fa8b85-42a2-4b0c-af4a-b61817e000f5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:28.771455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-30fa8b85-42a2-4b0c-af4a-b61817e000f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:28.835199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 544/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:29.107832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d5ff8-05b6-444b-a67c-0d4a2bd8975c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:29.152915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:29.205110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d5ff8-05b6-444b-a67c-0d4a2bd8975c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:29.238086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:29.238696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:29.238972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:29.239245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] PATH_INFO: `/v3/roles/9725dfa2820b46be91ddd0307e80f1e1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:29.240618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] RBAC: Authorizing `identity:get_role(role_id=9725dfa2820b46be91ddd0307e80f1e1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:29.241983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:29.243288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 582/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:29 2022] GET /identity/v3/roles/9725dfa2820b46be91ddd0307e80f1e1 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:20:29.248998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa8b85-42a2-4b0c-af4a-b61817e000f5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:29.344852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa8b85-42a2-4b0c-af4a-b61817e000f5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:29.370331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:29.377516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:29.384081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:29.384081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:29.384081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] PATH_INFO: `/v3/users/1a2028783bbd4cc3af86182b434feb51` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:29.384081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1a2028783bbd4cc3af86182b434feb51)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:29.384081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:29.384081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 545/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:29 2022] GET /identity/v3/users/1a2028783bbd4cc3af86182b434feb51 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:29.388533 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:29.482876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ee54b-b3a7-4072-9fb6-d8436191632b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:29.494878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:29.515149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:29.515741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:29.516032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:29.516280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:29.579160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:29.580569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:29.674565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 583/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:20:29.680806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:29.777011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892d9b-d310-4281-a461-34e90e3d30d8 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:29.809580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba89ce-55b2-478e-8698-936510e8fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:29.810190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba89ce-55b2-478e-8698-936510e8fd4d None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:29.810466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba89ce-55b2-478e-8698-936510e8fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:29.810734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba89ce-55b2-478e-8698-936510e8fd4d None admin] PATH_INFO: `/v3/projects/b0f6862c6e5048349222e5f99c4db3c0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:29.811821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba89ce-55b2-478e-8698-936510e8fd4d None admin] RBAC: Authorizing `identity:get_project(project_id=b0f6862c6e5048349222e5f99c4db3c0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:29.813269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba89ce-55b2-478e-8698-936510e8fd4d None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:29.814860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 546/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:29 2022] GET /identity/v3/projects/b0f6862c6e5048349222e5f99c4db3c0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:29.821558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:29.835686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:29.919072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b3341-b882-4995-a2a7-667c90917435 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:29.953432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8025bb4-403e-4059-95a6-54e3d13bc8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:29.953980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8025bb4-403e-4059-95a6-54e3d13bc8ad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:29.954236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8025bb4-403e-4059-95a6-54e3d13bc8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:29.954505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8025bb4-403e-4059-95a6-54e3d13bc8ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:29.955213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8025bb4-403e-4059-95a6-54e3d13bc8ad None admin] RBAC: Adding query filter params (role.id=9725dfa2820b46be91ddd0307e80f1e1, scope.project.id=b0f6862c6e5048349222e5f99c4db3c0, user.id=1a2028783bbd4cc3af86182b434feb51) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:29.955519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8025bb4-403e-4059-95a6-54e3d13bc8ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:29.956929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8025bb4-403e-4059-95a6-54e3d13bc8ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:29.962642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 584/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:29 2022] GET /identity/v3/role_assignments?user.id=1a2028783bbd4cc3af86182b434feb51&scope.project.id=b0f6862c6e5048349222e5f99c4db3c0&role.id=9725dfa2820b46be91ddd0307e80f1e1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:32.114621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7aad-6a6c-403f-872c-da2cf74d9f97 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:32.115119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7aad-6a6c-403f-872c-da2cf74d9f97 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:32.115119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7aad-6a6c-403f-872c-da2cf74d9f97 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:32.116929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 547/1131] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:32.122125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e654d-7913-4384-9a01-df3c9febbe7b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:32.122544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e654d-7913-4384-9a01-df3c9febbe7b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:32.122689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e654d-7913-4384-9a01-df3c9febbe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:32.141344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4a0e654d-7913-4384-9a01-df3c9febbe7b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:32.142526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4a0e654d-7913-4384-9a01-df3c9febbe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:32.205563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 585/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:32.476915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7aad-6a6c-403f-872c-da2cf74d9f97 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:32.538695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:32.575260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7aad-6a6c-403f-872c-da2cf74d9f97 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:32.608314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee19ff8-957a-4553-a528-7cb571152a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:32.608936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19ff8-957a-4553-a528-7cb571152a85 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:32.609251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19ff8-957a-4553-a528-7cb571152a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:32.609520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19ff8-957a-4553-a528-7cb571152a85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:32.610612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee19ff8-957a-4553-a528-7cb571152a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:32.612069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee19ff8-957a-4553-a528-7cb571152a85 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:32.613643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 548/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:32.619433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e654d-7913-4384-9a01-df3c9febbe7b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:32.627382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:32.716448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e654d-7913-4384-9a01-df3c9febbe7b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:32.749895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c11bb0-7e61-4bf0-95d2-ab751d98e6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:32.750458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c11bb0-7e61-4bf0-95d2-ab751d98e6a9 None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:32.750736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c11bb0-7e61-4bf0-95d2-ab751d98e6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:32.751007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c11bb0-7e61-4bf0-95d2-ab751d98e6a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:32.751713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c11bb0-7e61-4bf0-95d2-ab751d98e6a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:32.753194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c11bb0-7e61-4bf0-95d2-ab751d98e6a9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:32.874841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 586/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:20:32 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:35.044477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b700-f07a-4b63-9257-cba488801a9d None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:35.045004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b700-f07a-4b63-9257-cba488801a9d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:35.045004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b700-f07a-4b63-9257-cba488801a9d None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:35.046357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 549/1135] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:35.051517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cafcdc-c4fe-4135-af62-cf3c5687e703 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:35.051913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cafcdc-c4fe-4135-af62-cf3c5687e703 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:35.052067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cafcdc-c4fe-4135-af62-cf3c5687e703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:35.070427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b4cafcdc-c4fe-4135-af62-cf3c5687e703 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:35.071598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b4cafcdc-c4fe-4135-af62-cf3c5687e703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:35.123112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:35.137381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 587/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:35.409050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0b700-f07a-4b63-9257-cba488801a9d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:35.506133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0b700-f07a-4b63-9257-cba488801a9d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:35.533668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:35.538807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d0a45-f8f8-4782-8831-72b36adcda03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:35.539417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0a45-f8f8-4782-8831-72b36adcda03 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:35.545635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0a45-f8f8-4782-8831-72b36adcda03 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:35.545635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0a45-f8f8-4782-8831-72b36adcda03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:35.545635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0a45-f8f8-4782-8831-72b36adcda03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:35.545635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0a45-f8f8-4782-8831-72b36adcda03 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:35.545635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 550/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:20:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:35.549579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cafcdc-c4fe-4135-af62-cf3c5687e703 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:35.644156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cafcdc-c4fe-4135-af62-cf3c5687e703 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:35.676320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10366c-2ecb-41db-92b0-45e9b15e463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:35.676852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10366c-2ecb-41db-92b0-45e9b15e463d None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:35.677164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10366c-2ecb-41db-92b0-45e9b15e463d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:35.677440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10366c-2ecb-41db-92b0-45e9b15e463d None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:35.678151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10366c-2ecb-41db-92b0-45e9b15e463d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:35.679553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10366c-2ecb-41db-92b0-45e9b15e463d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:35.747066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 588/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:20:35 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:37.931241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74379b-e996-44e8-af7f-16f88aa74082 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:37.931759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74379b-e996-44e8-af7f-16f88aa74082 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:37.931759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74379b-e996-44e8-af7f-16f88aa74082 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:37.933125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 551/1139] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:37.938463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191601d-0853-47ec-9375-440f2ee3e499 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:37.938834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191601d-0853-47ec-9375-440f2ee3e499 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:37.939067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191601d-0853-47ec-9375-440f2ee3e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:37.957356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1191601d-0853-47ec-9375-440f2ee3e499 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:37.958584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1191601d-0853-47ec-9375-440f2ee3e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:37.998203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:38.024993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 589/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:38.300010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74379b-e996-44e8-af7f-16f88aa74082 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:38.397524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74379b-e996-44e8-af7f-16f88aa74082 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:38.430254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:38.430857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:38.431136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:38.431408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:38.441123 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:38.446363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:38.447487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:38.448507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 552/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:38.453378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191601d-0853-47ec-9375-440f2ee3e499 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:38.547698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191601d-0853-47ec-9375-440f2ee3e499 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:38.580349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:38.580879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:38.581187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:38.581463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:38.582117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:38.582436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:38.584444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:38.592245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 590/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:38.598580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:38.656256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:38.694598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce76d-f07d-4314-8b3f-c95ac92efc84 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:38.728079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:38.728697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:38.728969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:38.729264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] PATH_INFO: `/v3/users/0a3655c46f6941f2a66144c6b5053b39` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:38.741806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] RBAC: Authorizing `identity:get_user(user_id=0a3655c46f6941f2a66144c6b5053b39)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:38.743239 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:38.744802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 553/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:38 2022] GET /identity/v3/users/0a3655c46f6941f2a66144c6b5053b39 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:38.750600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:38.784806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:38.845935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55832e8e-2638-4251-831a-dfd2aa9ecf3f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:38.880098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:38.881262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:38.881599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:38.881883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:38.946176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:38.947601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:38.978815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:39.041490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 591/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:20:39.047415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:39.144343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360ae97-b516-4a34-8c84-671ab99d554b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:39.160590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:39.176307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66482feb-6b23-46aa-a6b2-52652acc38bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:39.178815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66482feb-6b23-46aa-a6b2-52652acc38bc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:39.178815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66482feb-6b23-46aa-a6b2-52652acc38bc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:39.178815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66482feb-6b23-46aa-a6b2-52652acc38bc None admin] PATH_INFO: `/v3/projects/51b4ff175e694c7cbebb3d88241faa7f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:39.179157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66482feb-6b23-46aa-a6b2-52652acc38bc None admin] RBAC: Authorizing `identity:get_project(project_id=51b4ff175e694c7cbebb3d88241faa7f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:39.180461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66482feb-6b23-46aa-a6b2-52652acc38bc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:39.182075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 554/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:39 2022] GET /identity/v3/projects/51b4ff175e694c7cbebb3d88241faa7f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:39.188080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:39.282812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a31aa-e430-45f8-be74-6bf0d98bacd0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:39.316175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a14d4-16a9-469e-ae7e-77a732187910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:39.316769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a14d4-16a9-469e-ae7e-77a732187910 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:39.317064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a14d4-16a9-469e-ae7e-77a732187910 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:39.317340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a14d4-16a9-469e-ae7e-77a732187910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:39.318112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a14d4-16a9-469e-ae7e-77a732187910 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=51b4ff175e694c7cbebb3d88241faa7f, user.id=0a3655c46f6941f2a66144c6b5053b39) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:39.318578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a14d4-16a9-469e-ae7e-77a732187910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:39.319988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a14d4-16a9-469e-ae7e-77a732187910 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:39.322733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:39.327144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 592/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:39 2022] GET /identity/v3/role_assignments?user.id=0a3655c46f6941f2a66144c6b5053b39&scope.project.id=51b4ff175e694c7cbebb3d88241faa7f&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:41.421295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283f70f-d9c7-486a-96f4-72e81f0cd2f6 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:41.421853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283f70f-d9c7-486a-96f4-72e81f0cd2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:41.421853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283f70f-d9c7-486a-96f4-72e81f0cd2f6 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:41.423196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 555/1147] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:41.428750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249340-ad85-4f21-b311-4b11f99dea07 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:41.429195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249340-ad85-4f21-b311-4b11f99dea07 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:41.429316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249340-ad85-4f21-b311-4b11f99dea07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:41.447480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ad249340-ad85-4f21-b311-4b11f99dea07 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:41.448654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ad249340-ad85-4f21-b311-4b11f99dea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:41.512593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 593/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:41.782976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283f70f-d9c7-486a-96f4-72e81f0cd2f6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:41.882484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283f70f-d9c7-486a-96f4-72e81f0cd2f6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:41.914665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:41.915279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:41.915556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:41.915823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:41.925564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:41.930943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:41.932047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:41.932913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 556/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:20:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:41.938036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249340-ad85-4f21-b311-4b11f99dea07 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:42.033117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249340-ad85-4f21-b311-4b11f99dea07 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:42.060192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:42.065468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:42.066065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:42.066338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:42.066604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:42.067249 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:42.067545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:42.069543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:42.077263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 594/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:42.083210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:42.130929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:42.182293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abdf8f-bdf6-4d1d-9b9b-c9cb78f14c21 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:42.215290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:42.215898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:42.216177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:42.216447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] PATH_INFO: `/v3/users/0a3655c46f6941f2a66144c6b5053b39` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:42.217621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3655c46f6941f2a66144c6b5053b39)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:42.219300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:42.220841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 557/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:42 2022] GET /identity/v3/users/0a3655c46f6941f2a66144c6b5053b39 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:42.227413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:42.324209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6ff1-1b9e-4646-acc9-739f09f22e99 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:42.356749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1f384-81d6-49cf-ac00-fb1b3a58b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:42.357383 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f384-81d6-49cf-ac00-fb1b3a58b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:42.357662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f384-81d6-49cf-ac00-fb1b3a58b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:42.357937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f384-81d6-49cf-ac00-fb1b3a58b0d0 None admin] PATH_INFO: `/v3/projects/51b4ff175e694c7cbebb3d88241faa7f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:42.359032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1f384-81d6-49cf-ac00-fb1b3a58b0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=51b4ff175e694c7cbebb3d88241faa7f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:42.360442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1f384-81d6-49cf-ac00-fb1b3a58b0d0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:42.362067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 595/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:42 2022] GET /identity/v3/projects/51b4ff175e694c7cbebb3d88241faa7f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:42.368712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:42.466197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb457d6-7083-4f1c-b982-f3500f9540a1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:42.480720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:42.500534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed3522-c20a-4e4c-b6bd-98c853dfc9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:42.501224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3522-c20a-4e4c-b6bd-98c853dfc9dd None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:42.501509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3522-c20a-4e4c-b6bd-98c853dfc9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:42.501786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3522-c20a-4e4c-b6bd-98c853dfc9dd None admin] PATH_INFO: `/v3/projects/51b4ff175e694c7cbebb3d88241faa7f/users/0a3655c46f6941f2a66144c6b5053b39/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:42.503657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed3522-c20a-4e4c-b6bd-98c853dfc9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=51b4ff175e694c7cbebb3d88241faa7f, user_id=0a3655c46f6941f2a66144c6b5053b39, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:42.505112 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed3522-c20a-4e4c-b6bd-98c853dfc9dd None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:42.592242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 558/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:20:42 2022] PUT /identity/v3/projects/51b4ff175e694c7cbebb3d88241faa7f/users/0a3655c46f6941f2a66144c6b5053b39/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:20:44.810485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8eb6-b57d-4a4e-9096-398bb89d5b33 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:44.811066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8eb6-b57d-4a4e-9096-398bb89d5b33 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:44.811066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8eb6-b57d-4a4e-9096-398bb89d5b33 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:44.812406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 596/1154] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:44.818143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7d73f-6f36-4b91-9e2b-ae19ecf09ead None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:44.818642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7d73f-6f36-4b91-9e2b-ae19ecf09ead None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:44.818836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7d73f-6f36-4b91-9e2b-ae19ecf09ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:44.837563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0ce7d73f-6f36-4b91-9e2b-ae19ecf09ead None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:44.838745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0ce7d73f-6f36-4b91-9e2b-ae19ecf09ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:44.904548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 559/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:45.175015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8eb6-b57d-4a4e-9096-398bb89d5b33 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:45.235176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:45.275303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8eb6-b57d-4a4e-9096-398bb89d5b33 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:45.308167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:45.308785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:45.309089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:45.309367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:45.319524 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:20:45.324250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:45.325453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:20:45.326642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 597/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:45.331376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7d73f-6f36-4b91-9e2b-ae19ecf09ead None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:45.428410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7d73f-6f36-4b91-9e2b-ae19ecf09ead None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:45.430644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:45.461977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:45.462572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:45.462850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:45.463120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:45.463780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:45.464079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:45.465462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:45.473550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 560/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:20:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:45.479947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:45.576892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c892b2-7672-47f2-9271-6cc4700ce0d4 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:45.596051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:45.609905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:45.610522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:45.610800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:45.611073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] PATH_INFO: `/v3/users/0a3655c46f6941f2a66144c6b5053b39` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:45.612168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] RBAC: Authorizing `identity:get_user(user_id=0a3655c46f6941f2a66144c6b5053b39)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:45.613749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:45.616155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 598/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:20:45 2022] GET /identity/v3/users/0a3655c46f6941f2a66144c6b5053b39 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:45.621513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:45.717361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66f38d-a1e6-4d24-9a0f-91910b3cb172 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:45.749662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:45.750255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:45.750531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:45.750800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:45.783097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:45.816405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:45.817982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:45.913170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 561/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:20:45.918981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:46.013805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce928-72d2-427d-a8ba-7350623fac3c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:46.045537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1e20e-bc09-4fa5-b357-90bed771f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:46.046150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1e20e-bc09-4fa5-b357-90bed771f34c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:46.046427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1e20e-bc09-4fa5-b357-90bed771f34c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:46.046697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1e20e-bc09-4fa5-b357-90bed771f34c None admin] PATH_INFO: `/v3/projects/51b4ff175e694c7cbebb3d88241faa7f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:46.047788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1e20e-bc09-4fa5-b357-90bed771f34c None admin] RBAC: Authorizing `identity:get_project(project_id=51b4ff175e694c7cbebb3d88241faa7f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:46.049237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1e20e-bc09-4fa5-b357-90bed771f34c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:46.050818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 599/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:20:45 2022] GET /identity/v3/projects/51b4ff175e694c7cbebb3d88241faa7f => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:46.056753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:46.121438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:46.155271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974095b-0f49-40e2-990d-fce99554c94b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:46.187567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9f90e-0ba5-45d9-9ed7-c28d9af79aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:46.188157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9f90e-0ba5-45d9-9ed7-c28d9af79aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:46.188431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9f90e-0ba5-45d9-9ed7-c28d9af79aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:46.188697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9f90e-0ba5-45d9-9ed7-c28d9af79aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:46.189435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9f90e-0ba5-45d9-9ed7-c28d9af79aa0 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=51b4ff175e694c7cbebb3d88241faa7f, user.id=0a3655c46f6941f2a66144c6b5053b39) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:46.189737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9f90e-0ba5-45d9-9ed7-c28d9af79aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:46.191136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9f90e-0ba5-45d9-9ed7-c28d9af79aa0 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:46.197158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 562/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:20:46 2022] GET /identity/v3/role_assignments?user.id=0a3655c46f6941f2a66144c6b5053b39&scope.project.id=51b4ff175e694c7cbebb3d88241faa7f&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:48.355091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084190a-b316-4bad-b08f-c0b8ff7eebe3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:48.355639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084190a-b316-4bad-b08f-c0b8ff7eebe3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:48.355639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084190a-b316-4bad-b08f-c0b8ff7eebe3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:48.356960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 600/1162] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:48.362132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e438-e580-46d0-8c2b-06948f97fdc2 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:48.362569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e438-e580-46d0-8c2b-06948f97fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:48.362684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e438-e580-46d0-8c2b-06948f97fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:48.381579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9687e438-e580-46d0-8c2b-06948f97fdc2 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:48.382764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9687e438-e580-46d0-8c2b-06948f97fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:48.446635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 563/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:48.718308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084190a-b316-4bad-b08f-c0b8ff7eebe3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:48.773462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:48.815253 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084190a-b316-4bad-b08f-c0b8ff7eebe3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:48.847124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:48.847724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:48.847998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:48.848266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:48.915462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:48.916904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:48.969533 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:49.012527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 601/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:20:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:20:49.018414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e438-e580-46d0-8c2b-06948f97fdc2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:49.074679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:49.113574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e438-e580-46d0-8c2b-06948f97fdc2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:49.146583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9637952-a905-49e4-b4ad-2ef89eabcd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:49.147199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9637952-a905-49e4-b4ad-2ef89eabcd10 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:49.147472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9637952-a905-49e4-b4ad-2ef89eabcd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:49.147737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9637952-a905-49e4-b4ad-2ef89eabcd10 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:49.154151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9637952-a905-49e4-b4ad-2ef89eabcd10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:49.155576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9637952-a905-49e4-b4ad-2ef89eabcd10 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-f9637952-a905-49e4-b4ad-2ef89eabcd10 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:20:49.168902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:20:49.170149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:20:49.171204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 564/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:20:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:20:49.176022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:49.275637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6d345-f55d-4dc3-b0ca-18537ad64576 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:49.309257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfc7fc-24ad-4764-a0d8-911cb819af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:49.309857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfc7fc-24ad-4764-a0d8-911cb819af05 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:49.310137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfc7fc-24ad-4764-a0d8-911cb819af05 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:49.310412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfc7fc-24ad-4764-a0d8-911cb819af05 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:49.311045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfc7fc-24ad-4764-a0d8-911cb819af05 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:20:49.311351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfc7fc-24ad-4764-a0d8-911cb819af05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:49.312727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfc7fc-24ad-4764-a0d8-911cb819af05 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:49.320813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 602/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Fri Sep 9 21:20:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:51.434773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff78b-0e49-4a31-84dc-6390668678ed None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:51.435306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff78b-0e49-4a31-84dc-6390668678ed None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:51.435306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfff78b-0e49-4a31-84dc-6390668678ed None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:51.436632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 565/1167] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:51.441893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185d2aa-4899-436d-ba5b-f3d8d7f0ae55 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:51.442314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185d2aa-4899-436d-ba5b-f3d8d7f0ae55 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:51.442467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185d2aa-4899-436d-ba5b-f3d8d7f0ae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:51.460044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d185d2aa-4899-436d-ba5b-f3d8d7f0ae55 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:51.461263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d185d2aa-4899-436d-ba5b-f3d8d7f0ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:51.475743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:51.525177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 603/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:51.794379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfff78b-0e49-4a31-84dc-6390668678ed None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:51.891764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfff78b-0e49-4a31-84dc-6390668678ed None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:51.911660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:51.924489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fe4ba-ab0d-439b-af4b-1f81be3b2800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:51.925160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fe4ba-ab0d-439b-af4b-1f81be3b2800 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:51.925437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fe4ba-ab0d-439b-af4b-1f81be3b2800 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:51.925700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fe4ba-ab0d-439b-af4b-1f81be3b2800 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:51.926362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fe4ba-ab0d-439b-af4b-1f81be3b2800 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:51.928066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fe4ba-ab0d-439b-af4b-1f81be3b2800 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:52.004624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 566/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Fri Sep 9 21:20:51 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:54.175662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0250-117a-44e2-8cee-5105275139c1 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:54.176165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0250-117a-44e2-8cee-5105275139c1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:54.176165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0250-117a-44e2-8cee-5105275139c1 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:54.178000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 604/1170] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:54.183262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5ccd8-9c3c-45f3-9ea6-a35c94949e61 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:54.183666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5ccd8-9c3c-45f3-9ea6-a35c94949e61 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:54.183818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5ccd8-9c3c-45f3-9ea6-a35c94949e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:54.202279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-50f5ccd8-9c3c-45f3-9ea6-a35c94949e61 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:54.203457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-50f5ccd8-9c3c-45f3-9ea6-a35c94949e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:54.269261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 567/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:54.536578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0250-117a-44e2-8cee-5105275139c1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:54.632094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0250-117a-44e2-8cee-5105275139c1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:54.664465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0e337-787f-4299-8391-f756f5e149db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:54.665165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e337-787f-4299-8391-f756f5e149db None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:54.665446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e337-787f-4299-8391-f756f5e149db None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:54.665716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e337-787f-4299-8391-f756f5e149db None admin] PATH_INFO: `/v3/domains/ae36744158a64655a743e1daf279115a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:54.675515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0e337-787f-4299-8391-f756f5e149db None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae36744158a64655a743e1daf279115a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:54.677220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0e337-787f-4299-8391-f756f5e149db None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:54.678763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 605/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Fri Sep 9 21:20:54 2022] GET /identity/v3/domains/ae36744158a64655a743e1daf279115a => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:54.684523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5ccd8-9c3c-45f3-9ea6-a35c94949e61 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:54.780167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5ccd8-9c3c-45f3-9ea6-a35c94949e61 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:54.790996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:54.812984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f43186-e011-444c-a946-a8b62564601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:54.815463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f43186-e011-444c-a946-a8b62564601e None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:54.815463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f43186-e011-444c-a946-a8b62564601e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:54.815463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f43186-e011-444c-a946-a8b62564601e None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:54.815463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f43186-e011-444c-a946-a8b62564601e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:54.816164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f43186-e011-444c-a946-a8b62564601e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:54.873286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 568/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:20:54 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:57.032137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b39c-e9ed-4354-ad23-43bf13768443 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:57.032655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b39c-e9ed-4354-ad23-43bf13768443 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:57.032655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b39c-e9ed-4354-ad23-43bf13768443 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:57.034050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 606/1174] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:57.039492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e75fd-2878-47b4-b2a2-89c3b0c2c991 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:57.039881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e75fd-2878-47b4-b2a2-89c3b0c2c991 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:57.040042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e75fd-2878-47b4-b2a2-89c3b0c2c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:57.058431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-208e75fd-2878-47b4-b2a2-89c3b0c2c991 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:57.059605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-208e75fd-2878-47b4-b2a2-89c3b0c2c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:57.124456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 569/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:20:57.394337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b39c-e9ed-4354-ad23-43bf13768443 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:57.407512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:57.492991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b39c-e9ed-4354-ad23-43bf13768443 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:57.525711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9a8f-c4ab-44fd-8f30-cc90ce471978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:57.526329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9a8f-c4ab-44fd-8f30-cc90ce471978 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:57.526609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9a8f-c4ab-44fd-8f30-cc90ce471978 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:57.526884 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9a8f-c4ab-44fd-8f30-cc90ce471978 None admin] PATH_INFO: `/v3/domains/ae36744158a64655a743e1daf279115a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:57.527982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9a8f-c4ab-44fd-8f30-cc90ce471978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae36744158a64655a743e1daf279115a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:57.529429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9a8f-c4ab-44fd-8f30-cc90ce471978 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:57.530964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 607/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Fri Sep 9 21:20:57 2022] GET /identity/v3/domains/ae36744158a64655a743e1daf279115a => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:20:57.536671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e75fd-2878-47b4-b2a2-89c3b0c2c991 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:20:57.623858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:57.632710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e75fd-2878-47b4-b2a2-89c3b0c2c991 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:20:57.665964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a5548-e565-4c34-a0cb-58c5f65bf61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:20:57.666719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a5548-e565-4c34-a0cb-58c5f65bf61b None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:57.667349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a5548-e565-4c34-a0cb-58c5f65bf61b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:57.667622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a5548-e565-4c34-a0cb-58c5f65bf61b None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:57.668267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a5548-e565-4c34-a0cb-58c5f65bf61b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:20:57.669728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a5548-e565-4c34-a0cb-58c5f65bf61b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:20:57.728727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 570/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:20:57 2022] POST /identity/v3/users => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:20:59.895864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc724a-9cd5-490d-8069-a66ed544c4c3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:59.896354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc724a-9cd5-490d-8069-a66ed544c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:59.896448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc724a-9cd5-490d-8069-a66ed544c4c3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:59.897766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 608/1178] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:20:59.902854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6994a6-e93c-498c-878c-533cae7e6f9f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:20:59.903266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6994a6-e93c-498c-878c-533cae7e6f9f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:20:59.903407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6994a6-e93c-498c-878c-533cae7e6f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:20:59.925403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5f6994a6-e93c-498c-878c-533cae7e6f9f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:20:59.927108 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5f6994a6-e93c-498c-878c-533cae7e6f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:20:59.992449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 571/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:20:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:21:00.263565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc724a-9cd5-490d-8069-a66ed544c4c3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:00.340116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:00.361490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc724a-9cd5-490d-8069-a66ed544c4c3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:00.394348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:00.395557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:00.395833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:00.396104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:00.405725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:21:00.410426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:21:00.411588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:21:00.412618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 609/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:21:00.417689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6994a6-e93c-498c-878c-533cae7e6f9f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:00.492010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:00.512756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6994a6-e93c-498c-878c-533cae7e6f9f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:00.545831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:00.546423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:00.546732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:00.547000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:00.547648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:21:00.547944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:00.549328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:00.558206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 572/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:00.564758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:00.664996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7baa24-317e-4740-b7e0-a141791048e2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:00.696954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:00.697597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:00.697875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:00.698148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] PATH_INFO: `/v3/users/ef117eba91dc4ec6bead8f92480180f1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:00.705488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:00.711327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] RBAC: Authorizing `identity:get_user(user_id=ef117eba91dc4ec6bead8f92480180f1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:00.712744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:00.714353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 610/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:21:00 2022] GET /identity/v3/users/ef117eba91dc4ec6bead8f92480180f1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:00.720620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:00.816114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba88e7-9091-4937-bdc9-f85ab143f988 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:00.848954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:00.849578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:00.849854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:00.850117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:00.860756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:00.916119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:00.917607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:01.010269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 573/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:21:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:21:01.016428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:01.115405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68422d-fdf0-47f5-ad87-920b2b03517a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:01.148711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec8270-a33d-4384-8c52-e8a41ee4669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:01.149351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8270-a33d-4384-8c52-e8a41ee4669f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:01.149633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8270-a33d-4384-8c52-e8a41ee4669f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:01.149908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec8270-a33d-4384-8c52-e8a41ee4669f None admin] PATH_INFO: `/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:01.151023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec8270-a33d-4384-8c52-e8a41ee4669f None admin] RBAC: Authorizing `identity:get_project(project_id=b10276a6a1ea4645b0ffeff987f55ba1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:01.152428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec8270-a33d-4384-8c52-e8a41ee4669f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:01.154055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 611/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:21:01 2022] GET /identity/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:01.160158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:01.199866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:01.255891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69661-57ee-4f74-a830-f203c3355f81 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:01.288178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45e3b-6127-42aa-889e-bedf59bce3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:01.288767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45e3b-6127-42aa-889e-bedf59bce3bc None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:01.289065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45e3b-6127-42aa-889e-bedf59bce3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:01.289337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45e3b-6127-42aa-889e-bedf59bce3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:01.290045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45e3b-6127-42aa-889e-bedf59bce3bc None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=b10276a6a1ea4645b0ffeff987f55ba1, user.id=ef117eba91dc4ec6bead8f92480180f1) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:21:01.290349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45e3b-6127-42aa-889e-bedf59bce3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:01.291754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45e3b-6127-42aa-889e-bedf59bce3bc None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:01.296844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 574/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:21:01 2022] GET /identity/v3/role_assignments?user.id=ef117eba91dc4ec6bead8f92480180f1&scope.project.id=b10276a6a1ea4645b0ffeff987f55ba1&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:03.414468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73a412-9810-41ff-8bd2-b21b66320c64 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:03.414997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73a412-9810-41ff-8bd2-b21b66320c64 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:03.414997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73a412-9810-41ff-8bd2-b21b66320c64 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:03.416352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 612/1186] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:21:03.421525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320a37-fc8f-4d2c-baa8-c78a29646a46 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:03.421942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320a37-fc8f-4d2c-baa8-c78a29646a46 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:03.422069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320a37-fc8f-4d2c-baa8-c78a29646a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:03.439617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-91320a37-fc8f-4d2c-baa8-c78a29646a46 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:21:03.440778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-91320a37-fc8f-4d2c-baa8-c78a29646a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:21:03.505826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 575/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:21:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:21:03.772737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73a412-9810-41ff-8bd2-b21b66320c64 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:03.833628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:03.871746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73a412-9810-41ff-8bd2-b21b66320c64 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:03.903788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:03.904415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:03.904694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:03.904968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:03.916476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:21:03.921231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:21:03.922325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:21:03.923196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 613/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:21:03.928451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320a37-fc8f-4d2c-baa8-c78a29646a46 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:03.961315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:04.024276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320a37-fc8f-4d2c-baa8-c78a29646a46 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:04.056115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:04.056759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:04.057058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:04.057333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:04.057985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:21:04.058283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:04.059629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:04.067941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 576/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:04.073718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:04.170530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29358a6-65e1-4118-b6ec-f52437a088db None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:04.192765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:04.202774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:04.203387 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:04.203668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:04.203943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] PATH_INFO: `/v3/users/ef117eba91dc4ec6bead8f92480180f1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:04.205064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] RBAC: Authorizing `identity:get_user(user_id=ef117eba91dc4ec6bead8f92480180f1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:04.206476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:04.208684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 614/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:21:04 2022] GET /identity/v3/users/ef117eba91dc4ec6bead8f92480180f1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:04.214375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:04.312951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:04.319676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403a218-8a4f-47b0-ba12-30ecc1b4eb68 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:04.353952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd726e-29cd-434b-be00-22e7d8afe117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:04.354575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd726e-29cd-434b-be00-22e7d8afe117 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:04.354863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd726e-29cd-434b-be00-22e7d8afe117 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:04.355140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd726e-29cd-434b-be00-22e7d8afe117 None admin] PATH_INFO: `/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:04.356248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd726e-29cd-434b-be00-22e7d8afe117 None admin] RBAC: Authorizing `identity:get_project(project_id=b10276a6a1ea4645b0ffeff987f55ba1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:04.357868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd726e-29cd-434b-be00-22e7d8afe117 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:04.359482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 577/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:21:04 2022] GET /identity/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:04.366240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:04.465693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36f41a-05bf-4bec-b40c-c8ecc6f25a83 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:04.498598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d77f88-451c-4ead-8eb7-3dcb6df11167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:04.499236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77f88-451c-4ead-8eb7-3dcb6df11167 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:04.499510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77f88-451c-4ead-8eb7-3dcb6df11167 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:04.499778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77f88-451c-4ead-8eb7-3dcb6df11167 None admin] PATH_INFO: `/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1/users/ef117eba91dc4ec6bead8f92480180f1/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:04.501635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d77f88-451c-4ead-8eb7-3dcb6df11167 None admin] RBAC: Authorizing `identity:create_grant(project_id=b10276a6a1ea4645b0ffeff987f55ba1, user_id=ef117eba91dc4ec6bead8f92480180f1, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:04.503034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d77f88-451c-4ead-8eb7-3dcb6df11167 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:04.557331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 615/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:21:04 2022] PUT /identity/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1/users/ef117eba91dc4ec6bead8f92480180f1/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:21:06.678759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706edc-0672-4de7-bc44-a14e65b2d3df None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:06.679312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706edc-0672-4de7-bc44-a14e65b2d3df None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:06.679312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706edc-0672-4de7-bc44-a14e65b2d3df None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:06.680628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 578/1193] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:21:06.686016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6818-19ba-4656-b37b-6c2a5d397a27 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:06.686431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6818-19ba-4656-b37b-6c2a5d397a27 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:06.686571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b6818-19ba-4656-b37b-6c2a5d397a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:06.705085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-561b6818-19ba-4656-b37b-6c2a5d397a27 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:21:06.706254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-561b6818-19ba-4656-b37b-6c2a5d397a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:21:06.751673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:06.770736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 616/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:21:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:21:07.043923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56706edc-0672-4de7-bc44-a14e65b2d3df None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:07.142804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56706edc-0672-4de7-bc44-a14e65b2d3df None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:07.174995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:07.175722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:07.176595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:07.176885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:07.187423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:21:07.192192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:21:07.193316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:21:07.194386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 579/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:21:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:21:07.199423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b6818-19ba-4656-b37b-6c2a5d397a27 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:07.296362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b6818-19ba-4656-b37b-6c2a5d397a27 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:07.328668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:07.329288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:07.329570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:07.329842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:07.330492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:21:07.330794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:07.332649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:07.340327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 617/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:07.346570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:07.371727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:07.444641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281d15-2be1-4b8f-8037-52db1faa9221 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:07.478026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:07.478639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:07.478915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:07.479185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] PATH_INFO: `/v3/users/ef117eba91dc4ec6bead8f92480180f1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:07.480270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] RBAC: Authorizing `identity:get_user(user_id=ef117eba91dc4ec6bead8f92480180f1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:07.481723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:07.483265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 580/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Fri Sep 9 21:21:07 2022] GET /identity/v3/users/ef117eba91dc4ec6bead8f92480180f1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:07.489113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:07.532781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:07.585810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbb07e-9ae5-4998-b4c6-cda892a92284 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:07.618348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:07.618944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:07.619222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:07.619493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:07.683507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:07.684926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:07.726946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:07.778817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 618/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:21:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:21:07.784786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:07.875428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:07.884531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79004d4a-f29d-4e20-97f3-e205c0f301d1 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:07.918258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8eb4f-5f5f-4a97-adaa-6ebf888e815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:07.918871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8eb4f-5f5f-4a97-adaa-6ebf888e815b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:07.919146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8eb4f-5f5f-4a97-adaa-6ebf888e815b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:07.919471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8eb4f-5f5f-4a97-adaa-6ebf888e815b None admin] PATH_INFO: `/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:07.920560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8eb4f-5f5f-4a97-adaa-6ebf888e815b None admin] RBAC: Authorizing `identity:get_project(project_id=b10276a6a1ea4645b0ffeff987f55ba1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:07.922048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8eb4f-5f5f-4a97-adaa-6ebf888e815b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:07.923632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 581/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Fri Sep 9 21:21:07 2022] GET /identity/v3/projects/b10276a6a1ea4645b0ffeff987f55ba1 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:21:07.930082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:21:08.026169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f7726-856b-4061-8f81-8b99187a0c0f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:21:08.058219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936b9a4-87de-4f69-bfab-f8122cc5f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:21:08.058809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b9a4-87de-4f69-bfab-f8122cc5f597 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:21:08.059085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b9a4-87de-4f69-bfab-f8122cc5f597 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:21:08.059355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936b9a4-87de-4f69-bfab-f8122cc5f597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:21:08.060069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936b9a4-87de-4f69-bfab-f8122cc5f597 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=b10276a6a1ea4645b0ffeff987f55ba1, user.id=ef117eba91dc4ec6bead8f92480180f1) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:21:08.060376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936b9a4-87de-4f69-bfab-f8122cc5f597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:21:08.061824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936b9a4-87de-4f69-bfab-f8122cc5f597 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:21:08.067864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 619/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:21:07 2022] GET /identity/v3/role_assignments?user.id=ef117eba91dc4ec6bead8f92480180f1&scope.project.id=b10276a6a1ea4645b0ffeff987f55ba1&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:21:17.945886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=20 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:18.064839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:21.954124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74af73-6312-45ec-b06d-2c1b21c7c27f None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:21.954693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74af73-6312-45ec-b06d-2c1b21c7c27f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:21.954693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74af73-6312-45ec-b06d-2c1b21c7c27f None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:21.955984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 582/1201] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:21.961419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb18d7-e747-4af8-afde-ab4349b9ad66 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:21.961865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb18d7-e747-4af8-afde-ab4349b9ad66 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:21.961969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb18d7-e747-4af8-afde-ab4349b9ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:21.981144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8bdb18d7-e747-4af8-afde-ab4349b9ad66 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:21.982327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8bdb18d7-e747-4af8-afde-ab4349b9ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:22.048222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 620/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:22.326592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74af73-6312-45ec-b06d-2c1b21c7c27f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:22.427153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74af73-6312-45ec-b06d-2c1b21c7c27f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:22.460166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:22.460788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:22.461081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:22.461355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:22.471521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:22.472955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:22.488039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:22.489327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:22.490727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:22.490727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:22.490727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:22.490727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 583/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:22.495485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb18d7-e747-4af8-afde-ab4349b9ad66 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:22.592885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb18d7-e747-4af8-afde-ab4349b9ad66 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:22.620100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:22.625585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabac55-98b2-4fa8-a947-9a9af0036c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:22.626182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabac55-98b2-4fa8-a947-9a9af0036c36 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:22.626457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabac55-98b2-4fa8-a947-9a9af0036c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:22.626726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabac55-98b2-4fa8-a947-9a9af0036c36 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:22.627350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabac55-98b2-4fa8-a947-9a9af0036c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:22.627650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabac55-98b2-4fa8-a947-9a9af0036c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:22.628989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabac55-98b2-4fa8-a947-9a9af0036c36 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:22.640709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 621/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:22.647294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:22.703724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:22.750490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342582e6-a532-4509-9637-714faf61c2ef None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:22.790192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c9815-f0b5-4e0c-9d23-6ffa83176926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:22.792806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9815-f0b5-4e0c-9d23-6ffa83176926 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:22.792806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9815-f0b5-4e0c-9d23-6ffa83176926 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:22.792806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9815-f0b5-4e0c-9d23-6ffa83176926 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:22.792806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c9815-f0b5-4e0c-9d23-6ffa83176926 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:22.793433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c9815-f0b5-4e0c-9d23-6ffa83176926 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:22.874506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 584/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Fri Sep 9 21:22:22 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:22:25.070611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a027f3-819e-4607-b8c1-ad1345897c07 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:25.071160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a027f3-819e-4607-b8c1-ad1345897c07 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:25.071160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a027f3-819e-4607-b8c1-ad1345897c07 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:25.072477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 622/1206] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:22:25.077983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00948e-a837-4d25-88c9-38448acffe63 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:25.078381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00948e-a837-4d25-88c9-38448acffe63 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:25.078485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00948e-a837-4d25-88c9-38448acffe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:25.096706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ff00948e-a837-4d25-88c9-38448acffe63 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:25.097946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ff00948e-a837-4d25-88c9-38448acffe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:25.163246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 585/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:25.437224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a027f3-819e-4607-b8c1-ad1345897c07 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:25.539717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a027f3-819e-4607-b8c1-ad1345897c07 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:25.572858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:25.573510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:25.579182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:25.579182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:25.584799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:22:25.589887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:25.591073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:25.592030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 623/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:22:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:25.597181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00948e-a837-4d25-88c9-38448acffe63 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:25.636180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:25.694703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00948e-a837-4d25-88c9-38448acffe63 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:25.728198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:25.728793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:25.729105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:25.729379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:25.730028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:25.730328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:25.731693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:25.739378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 586/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:22:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:25.745794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:25.795816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:25.845475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4746b-6e51-412e-9a51-0fd925892042 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:25.879522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:25.880152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:25.880433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:25.880704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:25.891626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:25.893086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:25.908475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:25.909655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:25.910904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:25.910904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:25.910904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:25.910904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 624/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:25.916049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:26.012184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:26.015164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8874-1172-4b26-ab78-dcd25522b402 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:26.047902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:26.048511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:26.048793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:26.049095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:26.049735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:26.050039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:26.051723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:26.064898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 587/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:26.071339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:26.169422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8701238-c85e-4808-8d97-8368ee68d12c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:26.171024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:26.205366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:26.205993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:26.206271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:26.206542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:26.214340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:26.215789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:22:26.227401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:26.230211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:26.231225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 625/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:26.234610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:26.332927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d94f2-763b-4b27-8a02-837310c78961 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:26.367325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:26.367927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:26.368207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:26.368480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:26.369227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:26.369532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:26.371037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:26.388170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 588/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Sep 9 21:22:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:26.394048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:26.493478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc05be-db76-41b4-82d3-dc25af2d95a2 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:26.528204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:26.528805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:26.529112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:26.529384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:26.558668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:26.594121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:26.595491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:26.692191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 626/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:22:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 21:22:26.698164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:26.717297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:26.795868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38dae-1401-4423-9b85-36080cf1ab06 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:26.829874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:26.830495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:26.830769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:26.831037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:26.841814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:26.843243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:26.861471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:26.863217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:26.864300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:26.864300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:26.864300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:26.864300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 589/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:26.865485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:26.925159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:26.962252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdfb8c-ba8b-4ada-85c3-75b2ad4e9797 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:26.995064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:26.995715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:26.996473 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:26.996752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:26.997462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:26.997776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:27.002985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:27.010871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 627/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:27.016840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:27.086588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:27.115750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48853b1-2906-4ab0-995e-692941785dad None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:27.149607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:27.150229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:27.150509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:27.150779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:27.157249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:27.158723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:22:27.170205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:27.171318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:27.172237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 590/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:22:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:27.177516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:27.278574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd767336-5daa-4da2-b4d7-d65ca83ad94d None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:27.300744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:27.311897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2577e0-f5a0-442c-a790-cfc0c6061cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:27.312492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2577e0-f5a0-442c-a790-cfc0c6061cdc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:27.312766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2577e0-f5a0-442c-a790-cfc0c6061cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:27.313053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2577e0-f5a0-442c-a790-cfc0c6061cdc None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:27.313733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2577e0-f5a0-442c-a790-cfc0c6061cdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:27.314097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2577e0-f5a0-442c-a790-cfc0c6061cdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:27.323623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2577e0-f5a0-442c-a790-cfc0c6061cdc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:27.327242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 628/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:22:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:27.333452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:27.432653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9358f-0f15-4aec-90c0-125b7be5833a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:27.460384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:27.466152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754ee49-fc9c-4bc4-b444-23e417821c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:27.466749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754ee49-fc9c-4bc4-b444-23e417821c18 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:27.467027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754ee49-fc9c-4bc4-b444-23e417821c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:27.467308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754ee49-fc9c-4bc4-b444-23e417821c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:27.468013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754ee49-fc9c-4bc4-b444-23e417821c18 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=fa725c2a086f4964acefdadb45cc88ef) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:27.468320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754ee49-fc9c-4bc4-b444-23e417821c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:27.469771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754ee49-fc9c-4bc4-b444-23e417821c18 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:27.475341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 591/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:22:27 2022] GET /identity/v3/role_assignments?user.id=fa725c2a086f4964acefdadb45cc88ef&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:29.597661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63884e8-f213-41d0-bc4a-fe148ff1d20e None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:29.598219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63884e8-f213-41d0-bc4a-fe148ff1d20e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:29.598219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63884e8-f213-41d0-bc4a-fe148ff1d20e None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:29.599546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 629/1220] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:29.604761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3cd8-96e2-4afe-8a1b-01a2bb8c8b6e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:29.605168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3cd8-96e2-4afe-8a1b-01a2bb8c8b6e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:29.605341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3cd8-96e2-4afe-8a1b-01a2bb8c8b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:29.624188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2faf3cd8-96e2-4afe-8a1b-01a2bb8c8b6e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:29.625388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2faf3cd8-96e2-4afe-8a1b-01a2bb8c8b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:29.690321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 592/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:29.958583 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63884e8-f213-41d0-bc4a-fe148ff1d20e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:30.059362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63884e8-f213-41d0-bc4a-fe148ff1d20e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:30.092397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:30.093124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:30.093402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:30.093670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:30.104051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:22:30.108789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:30.109987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:30.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 630/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:22:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:30.116763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf3cd8-96e2-4afe-8a1b-01a2bb8c8b6e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:30.214233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf3cd8-96e2-4afe-8a1b-01a2bb8c8b6e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:30.237628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:30.248951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:30.249757 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:30.250036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:30.250317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:30.250975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:30.251277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:30.252623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:30.261087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 593/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:22:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:30.266881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:30.311268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:30.367531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f805-44bd-40f0-84fa-20a1c1ef2da7 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:30.400505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:30.401215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:30.401500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:30.401777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:30.411549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:30.413799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:30.428517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:30.429912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:30.430952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:30.430952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:30.430952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:30.430952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 631/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:30.435574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:30.546036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d25d4-f583-4692-88f4-78acfbae1ff6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:30.579045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:30.579636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:30.579916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:30.580190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:30.580821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:30.581151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:30.582517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:30.595273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 594/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:30.601753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:30.690871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:30.697302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61486c5b-164d-46a1-b228-cf25b0bcad95 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:30.730239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:30.730859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:30.731132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:30.731399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:30.738082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:30.739545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:22:30.750654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:30.751878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:30.753070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 632/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:30.757630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:30.803448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:30.855285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70f42-6fc5-4c47-b0b7-b096ed95ee22 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:30.889653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:30.890256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:30.890534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:30.890803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:30.891519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:30.891823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:30.893275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:30.910628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 595/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Sep 9 21:22:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:30.916641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:31.017385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4596db-5a48-4206-84eb-7dd6ee709649 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:31.051143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:31.051772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:31.052050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:31.052343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:31.062586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:31.064011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:31.078422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:31.085261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:31.086403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:31.086403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:31.086403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:31.086403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 633/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:22:31.086689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:31.183483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b8a3-5c00-4e9a-b46a-1794cc38df6c None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:31.185789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:31.217037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:31.217659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:31.217940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:31.218210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:31.218838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:31.219135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:31.220535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:31.231706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 596/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:31.237495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:31.247440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:31.334469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce6e6c-5c4d-4260-a2ff-53d8009d21cc None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:31.367123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:31.367743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:31.368017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:31.368284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:31.374690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:31.376100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:22:31.387543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:31.388645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:31.389810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 634/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:31.394731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:31.492974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2681b9-5547-40d6-b5f4-96f8613a3448 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:31.526205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba72c-6f55-4104-9632-cac325ee8592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:31.526801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba72c-6f55-4104-9632-cac325ee8592 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:31.527078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba72c-6f55-4104-9632-cac325ee8592 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:31.527345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba72c-6f55-4104-9632-cac325ee8592 None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:31.528028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba72c-6f55-4104-9632-cac325ee8592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:31.528334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba72c-6f55-4104-9632-cac325ee8592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:31.529767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cba72c-6f55-4104-9632-cac325ee8592 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:31.541908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 597/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:31.547961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:31.611363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:31.644688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cf7e4-f370-4735-b3e7-11e4ccbbc9e5 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:31.676547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2762f-1565-49ef-8d1e-4b87d9f06296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:31.677220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2762f-1565-49ef-8d1e-4b87d9f06296 None admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:31.678119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2762f-1565-49ef-8d1e-4b87d9f06296 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:31.678441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2762f-1565-49ef-8d1e-4b87d9f06296 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/fa725c2a086f4964acefdadb45cc88ef/roles/94b322ecf59e4767888638fc0e33204e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:31.692798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2762f-1565-49ef-8d1e-4b87d9f06296 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=fa725c2a086f4964acefdadb45cc88ef, role_id=94b322ecf59e4767888638fc0e33204e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:31.694382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2762f-1565-49ef-8d1e-4b87d9f06296 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:31.771145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 635/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:22:31 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/fa725c2a086f4964acefdadb45cc88ef/roles/94b322ecf59e4767888638fc0e33204e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:22:33.909580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e90b9-762e-428c-9e6c-d441d001c4f7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:33.910092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e90b9-762e-428c-9e6c-d441d001c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:33.910202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e90b9-762e-428c-9e6c-d441d001c4f7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:33.911595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 598/1233] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:33.917158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3efbda-676a-43af-9e81-aff89aca7182 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:33.917541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3efbda-676a-43af-9e81-aff89aca7182 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:33.917768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3efbda-676a-43af-9e81-aff89aca7182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:33.935612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8d3efbda-676a-43af-9e81-aff89aca7182 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:33.938790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8d3efbda-676a-43af-9e81-aff89aca7182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:34.002605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 636/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:34.274146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e90b9-762e-428c-9e6c-d441d001c4f7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:34.298782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:34.373261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e90b9-762e-428c-9e6c-d441d001c4f7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:34.407159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:34.407789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:34.408071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:34.408345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:34.418251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:22:34.422971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:34.424075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:34.425372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 599/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Fri Sep 9 21:22:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:34.430594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3efbda-676a-43af-9e81-aff89aca7182 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:34.475479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:34.527143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3efbda-676a-43af-9e81-aff89aca7182 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:34.559873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:34.560477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:34.560753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:34.561023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:34.561706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] RBAC: Adding query filter params (name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:34.562005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:34.563422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:34.571314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 637/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Fri Sep 9 21:22:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:34.577008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:34.659725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:34.676483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13d0ef-b395-47aa-bb67-1236b6e7386a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:34.710358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:34.710982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:34.711260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:34.711532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:34.721600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:34.723029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:34.738248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:34.741793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:34.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:34.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:34.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:34.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 600/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:34.746159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:34.844965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00900bd-afd3-46fa-a7d1-9b83a5051968 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:34.854587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:34.879412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:34.880019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:34.880329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:34.880605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:34.881450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:34.881756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:34.883105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:34.894413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 638/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:34.900807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:34.998220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097aa8a-cc56-4e05-9432-ce5bf566454b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:35.032416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:35.033062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:35.033337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:35.033605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:35.036192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:35.041830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:35.043255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:22:35.053952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:35.056361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:35.057616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 601/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:35.061044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:35.156960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79920-97fd-453d-acfd-b63147c92d0b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:35.189357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:35.189950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:35.190224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:35.190493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:35.191206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:35.191508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:35.192967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:35.209895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 639/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Sep 9 21:22:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:35.216297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:35.316233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f721d81-4544-4de9-82f4-1fb1d16031e5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:35.350039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:35.350671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:35.350946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:35.351208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:35.410795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:35.417274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:35.421427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:35.511670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 602/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:22:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:22:35.517673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:35.545103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:35.616205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580a4ef-10b8-499a-b151-687ba0639a3c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:35.650220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de024d55-ef44-461b-9800-97625118e182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:35.650849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de024d55-ef44-461b-9800-97625118e182 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:35.651126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de024d55-ef44-461b-9800-97625118e182 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:35.651393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de024d55-ef44-461b-9800-97625118e182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:35.661381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de024d55-ef44-461b-9800-97625118e182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:35.662842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de024d55-ef44-461b-9800-97625118e182 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-de024d55-ef44-461b-9800-97625118e182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:35.676693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:35.678285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:35.679391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:35.679391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:35.679391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:35.679391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 640/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:35.684362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:35.775340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:35.780903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa160-15be-4834-a2ab-aa859bf70b88 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:35.814085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:35.814688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:35.814965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:35.815236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:35.815892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:35.816194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:35.817590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:35.829086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 603/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:35.835326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de024d55-ef44-461b-9800-97625118e182 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:35.917483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:35.938937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de024d55-ef44-461b-9800-97625118e182 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:35.972692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:35.973362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:35.973645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:35.973963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:35.980952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:35.982395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:22:35.994418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:35.995346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:35.996426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 641/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:22:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:36.001454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:36.102937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc104e-1365-40be-984b-c695012678cb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:36.136012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c75e-22ab-4ad9-8e0e-7ece4aa3612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:36.136609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c75e-22ab-4ad9-8e0e-7ece4aa3612c None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:36.136887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c75e-22ab-4ad9-8e0e-7ece4aa3612c None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:36.137192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c75e-22ab-4ad9-8e0e-7ece4aa3612c None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:36.137879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c75e-22ab-4ad9-8e0e-7ece4aa3612c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:36.138185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c75e-22ab-4ad9-8e0e-7ece4aa3612c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:36.139682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c75e-22ab-4ad9-8e0e-7ece4aa3612c None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:36.151798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 604/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:36.157898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:36.255593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7b5ef-0b37-4cd0-abe9-6d4c1b40d1d1 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:36.287603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb1ff2-1372-4ca5-8981-4101703ab483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:36.288191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1ff2-1372-4ca5-8981-4101703ab483 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:36.292649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1ff2-1372-4ca5-8981-4101703ab483 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:36.292649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1ff2-1372-4ca5-8981-4101703ab483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:36.292649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb1ff2-1372-4ca5-8981-4101703ab483 None admin] RBAC: Adding query filter params (role.id=94b322ecf59e4767888638fc0e33204e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=fa725c2a086f4964acefdadb45cc88ef) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:36.292649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb1ff2-1372-4ca5-8981-4101703ab483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:36.292649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb1ff2-1372-4ca5-8981-4101703ab483 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:36.297118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 642/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:22:36 2022] GET /identity/v3/role_assignments?user.id=fa725c2a086f4964acefdadb45cc88ef&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=94b322ecf59e4767888638fc0e33204e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:22:38.504627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f88393-c9ab-4aa6-8677-2b316772cf29 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:38.505258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f88393-c9ab-4aa6-8677-2b316772cf29 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:38.505435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f88393-c9ab-4aa6-8677-2b316772cf29 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:38.506771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 605/1247] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:38.512039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed716b1-89ef-4166-b2b1-b0d2b6794bc4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:38.512465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed716b1-89ef-4166-b2b1-b0d2b6794bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:38.512631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed716b1-89ef-4166-b2b1-b0d2b6794bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:38.518879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:38.530836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fed716b1-89ef-4166-b2b1-b0d2b6794bc4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:38.532033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fed716b1-89ef-4166-b2b1-b0d2b6794bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:38.596664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 643/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:38.864495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f88393-c9ab-4aa6-8677-2b316772cf29 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:38.882276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:38.963972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f88393-c9ab-4aa6-8677-2b316772cf29 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:38.998693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:38.999319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:38.999596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:38.999864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:39.010171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:22:39.014739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:39.017414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:39.018541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 606/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:22:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:39.023370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed716b1-89ef-4166-b2b1-b0d2b6794bc4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:39.121429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed716b1-89ef-4166-b2b1-b0d2b6794bc4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:39.150438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:39.155314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:39.155914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:39.156190 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:39.156457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:39.157129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:39.157429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:39.158883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:39.166823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 644/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:39.172740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:39.249734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:39.272985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843162a9-c592-4166-a29f-c4bd2e239ceb None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:39.309124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:39.309742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:39.310014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:39.310279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:39.320997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:39.322451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:39.336482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:39.337933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:39.338861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:39.338861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:39.338861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:39.338861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 607/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:39.343755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:39.444168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c996261-605f-42c0-9d44-d4b60e6e9f1a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:39.477766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:39.478364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:39.478640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:39.478908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:39.479537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:39.479833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:39.481200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:39.492646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 645/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:39.498530 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:39.597660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a4af-a5cb-44e2-952c-863a1df3651b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:39.623867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:39.631825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:39.632468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:39.632750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:39.633041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:39.640289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:39.641799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:22:39.653615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:39.654585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:39.655563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 608/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:39.660984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:39.716586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:39.758600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb3c0e-9d3d-4418-b0ce-e6a900e5625c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:39.790957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:39.791552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:39.791827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:39.792098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:39.792805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:39.793143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:39.794615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:39.810888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 646/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Sep 9 21:22:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:39.816710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:39.919172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccf178-7704-4b00-8114-fc7c6f74fe1f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:39.952424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:39.953017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:39.953323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:39.953590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:40.008333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:40.019906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:40.021986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:40.117098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 609/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:22:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:22:40.123144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:40.220826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ed676-ff48-4b9e-b705-c0322baf10bd None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:40.233998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:40.254616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:40.255836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:40.256116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:40.256389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:40.266009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:40.267372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:40.281364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:40.282551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:40.283444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:40.283444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:40.283444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:40.283444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 647/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:40.288434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:40.374987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:40.387357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d256c2-28a8-41b1-8630-46af8fb515dd None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:40.421786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:40.422385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:40.422662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:40.422931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:40.423561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:40.423859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:40.425242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:40.437265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 610/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:40.443732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:40.542095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fbdba-1b7b-4d68-80d0-6f023531501b None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:40.574776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:40.575497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:40.575776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:40.576045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:40.582595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:40.584115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:22:40.595403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:40.599762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:40.600891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 648/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:40.603142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:40.701403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90eca7-02d4-482c-a8fe-378e0c58e62e None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:40.734876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ab5c1-8111-4b72-8cd8-a8b5f819d8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:40.735481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ab5c1-8111-4b72-8cd8-a8b5f819d8ad None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:40.735760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ab5c1-8111-4b72-8cd8-a8b5f819d8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:40.736028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ab5c1-8111-4b72-8cd8-a8b5f819d8ad None admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:40.736709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ab5c1-8111-4b72-8cd8-a8b5f819d8ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:40.737013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ab5c1-8111-4b72-8cd8-a8b5f819d8ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:40.738452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ab5c1-8111-4b72-8cd8-a8b5f819d8ad None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:40.750655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 611/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:40.757147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:40.782452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:40.855747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acd642-92c8-41eb-8fcf-acc3bf082e33 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:40.894714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216e4f5-6603-4ca1-a205-509e0b3608b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:40.895315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e4f5-6603-4ca1-a205-509e0b3608b9 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:40.896246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e4f5-6603-4ca1-a205-509e0b3608b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:40.896408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e4f5-6603-4ca1-a205-509e0b3608b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:40.897155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e4f5-6603-4ca1-a205-509e0b3608b9 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=fa725c2a086f4964acefdadb45cc88ef) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:40.897463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e4f5-6603-4ca1-a205-509e0b3608b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:40.898886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e4f5-6603-4ca1-a205-509e0b3608b9 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:40.904173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 649/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:22:40 2022] GET /identity/v3/role_assignments?user.id=fa725c2a086f4964acefdadb45cc88ef&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=eea82d73b0db450f9f23e5256483a93e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:43.041801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805720e-88c1-4d86-b3a7-256a7e2eac48 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:43.042327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805720e-88c1-4d86-b3a7-256a7e2eac48 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:43.042327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805720e-88c1-4d86-b3a7-256a7e2eac48 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:43.043680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 612/1261] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:43.048870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838b1c1-ef19-4dae-86ee-6552b2bbda4d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:43.052723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838b1c1-ef19-4dae-86ee-6552b2bbda4d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:43.052723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838b1c1-ef19-4dae-86ee-6552b2bbda4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:43.068726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d838b1c1-ef19-4dae-86ee-6552b2bbda4d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:43.069976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d838b1c1-ef19-4dae-86ee-6552b2bbda4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:43.136858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 650/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:43.409595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805720e-88c1-4d86-b3a7-256a7e2eac48 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:43.421383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:43.510922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805720e-88c1-4d86-b3a7-256a7e2eac48 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:43.545213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:43.545853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:43.546139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:43.546408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:43.556241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:22:43.560883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:43.562050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:43.563266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 613/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:22:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:43.568617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838b1c1-ef19-4dae-86ee-6552b2bbda4d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:43.587530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:43.671430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838b1c1-ef19-4dae-86ee-6552b2bbda4d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:43.704115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:43.704718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:43.704993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:43.705295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:43.705954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:43.706256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:43.707606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:43.716644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 651/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:22:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:43.722452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:43.790992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:43.833979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113de5-84e9-4d18-841b-2f0a58a81ec6 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:43.872437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:43.876280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:43.876280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:43.876280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:43.886399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:43.887843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:43.906590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:43.912267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:43.913356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:43.913356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:43.913356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:43.913356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 614/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:43.915173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:44.013096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:44.033601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2302c1-af45-4d43-9675-59152adca621 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:44.068510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:44.069180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:44.069443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:44.069715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:44.070354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:44.070655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:44.072013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:44.087901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 652/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:44.093604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:44.201866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399379db-7bd0-4709-a9a0-619f45018a5f None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:44.225292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:44.240738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:44.241519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:44.242007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:44.242288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:44.259249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:44.260758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:22:44.273402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:44.274421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:44.275430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 615/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:44.280557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:44.383500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404088-1013-45a9-8e13-e1e72729cc17 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:44.417731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:44.418335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:44.418663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:44.418936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:44.419710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:44.420016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:44.421467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:44.432127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:44.440826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 653/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Sep 9 21:22:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:44.447158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:44.547477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b78e-14f3-434b-bd65-e09f43c306e2 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:44.580736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:44.581417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:44.581666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:44.581933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:44.592460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:44.593915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:44.607961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:44.613269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:44.615896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:44.615896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:44.615896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:44.615896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 616/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:22:44.616184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:44.715458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f184266-f9d9-467d-9e5c-73b32aa9704e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:44.749236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:44.749829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:44.750106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:44.750373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:44.750999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:44.751297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:44.752705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:44.764799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 654/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:44.771030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:44.801981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:44.870119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b89f-41af-434e-a437-2d1c0878f300 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:44.902986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:44.903633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:44.903906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:44.904171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:44.910793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:44.912908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:22:44.923885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:44.924996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:44.926164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 617/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:22:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:44.931075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:44.988396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:45.027844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe2b62-c60b-4135-9460-1339eaa6185f None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:45.061800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700fe0a-d5be-4be9-a3ef-10b3aebd7831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:45.062333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700fe0a-d5be-4be9-a3ef-10b3aebd7831 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:45.062609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700fe0a-d5be-4be9-a3ef-10b3aebd7831 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:45.062878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700fe0a-d5be-4be9-a3ef-10b3aebd7831 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:45.063555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700fe0a-d5be-4be9-a3ef-10b3aebd7831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:45.063856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700fe0a-d5be-4be9-a3ef-10b3aebd7831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:45.065343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700fe0a-d5be-4be9-a3ef-10b3aebd7831 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:45.077706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 655/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:45.084805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:45.172479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:45.180670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc876819-50a6-4261-809e-3ffe12daa3b5 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:45.213192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43fb7a-5a39-4bfc-857a-a30ffdc80614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:45.213849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43fb7a-5a39-4bfc-857a-a30ffdc80614 None admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:45.214124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43fb7a-5a39-4bfc-857a-a30ffdc80614 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:45.214499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43fb7a-5a39-4bfc-857a-a30ffdc80614 None admin] PATH_INFO: `/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/fa725c2a086f4964acefdadb45cc88ef/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:45.216387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43fb7a-5a39-4bfc-857a-a30ffdc80614 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bad538f2c4a8a937e26b80079a4e5, user_id=fa725c2a086f4964acefdadb45cc88ef, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:45.217865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43fb7a-5a39-4bfc-857a-a30ffdc80614 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:45.330498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 618/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Fri Sep 9 21:22:45 2022] PUT /identity/v3/projects/ea6bad538f2c4a8a937e26b80079a4e5/users/fa725c2a086f4964acefdadb45cc88ef/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:22:47.473863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c6ff-9f5f-4fa4-9726-c4ece6f0f1d7 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:47.474502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c6ff-9f5f-4fa4-9726-c4ece6f0f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:47.474502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c6ff-9f5f-4fa4-9726-c4ece6f0f1d7 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:47.475722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 656/1274] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:47.481080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492030d-274f-424d-ba74-ba2ea436cf30 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:47.481473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492030d-274f-424d-ba74-ba2ea436cf30 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:47.481623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492030d-274f-424d-ba74-ba2ea436cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:47.500256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e492030d-274f-424d-ba74-ba2ea436cf30 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:47.501458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e492030d-274f-424d-ba74-ba2ea436cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:47.567094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 619/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:47.836285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888c6ff-9f5f-4fa4-9726-c4ece6f0f1d7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:47.935893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888c6ff-9f5f-4fa4-9726-c4ece6f0f1d7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:47.953459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:47.970295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:47.970920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:47.971204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:47.971475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:47.981622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 21:22:47.986522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:47.987738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:47.989421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 657/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Fri Sep 9 21:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:47.994264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492030d-274f-424d-ba74-ba2ea436cf30 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:48.072991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:48.090637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492030d-274f-424d-ba74-ba2ea436cf30 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:48.124240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:48.124837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:48.125147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:48.125419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:48.126074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:48.126374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:48.127730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:48.135446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 620/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Fri Sep 9 21:22:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:48.141364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:48.240349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e2e1f-dc0e-4623-a876-c7e008c1c55a None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:48.272949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:48.273591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:48.273868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:48.274137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:48.283815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:48.285269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:48.299691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:48.302826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:48.303724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:48.303724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:48.303724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:48.303724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 658/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:48.307401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:48.407913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639656bd-6bc1-4706-b9c8-809f0423e5f9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:48.440731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:48.441356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:48.441631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:48.441898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:48.442654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:48.442988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:48.444331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:48.455754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 621/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:48.462362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:48.493158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:48.558928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30328e-bbaf-4fff-93ab-82314d755c2c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:48.592274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:48.592933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:48.593245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:48.593518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:48.600808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:48.604258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 21:22:48.614201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:48.615380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:48.616703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 659/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:48.621191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:48.626573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:48.719670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657af86-8744-4510-ac82-fe4bb3648d92 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:48.752819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:48.753468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:48.753743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:48.754010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:48.754723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:48.755111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:48.756567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:48.773622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 622/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Fri Sep 9 21:22:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:48.779459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:48.870272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:48.880048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007d51a-b2e3-4df0-aff4-2e9103b48552 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:48.912327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:48.912924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:48.913243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:48.913515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:48.979137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:48.980498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:49.065716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:49.076158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 660/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Fri Sep 9 21:22:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 21:22:49.082253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:49.142473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:49.180402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc823-2d89-4461-94c8-5e3202b9cf07 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:49.215357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:49.215983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:49.216259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:49.216528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:49.226460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:49.227894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 21:22:49.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:49.244208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 21:22:49.245283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 21:22:49.245283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 21:22:49.245283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:49.245283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 623/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:22:49.249845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:49.344895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d3752-0343-45bb-9115-acc162e1c55c None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:49.377922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:49.378518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:49.378795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:49.379064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:49.380280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:49.380578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:49.381948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:49.392740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 661/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Fri Sep 9 21:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:49.398620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:49.496446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026785-9dd2-4598-8bf3-d8608dd4d52a None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:49.510502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:49.531181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:49.531801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:49.532076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:49.532343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:49.539653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:49.541206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 21:22:49.554097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:49.559068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: ERROR keystone.server.flask.application Sep 09 21:22:49.560147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 624/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Fri Sep 9 21:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:49.561058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:49.609828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:49.659501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58577bfa-36dc-48d2-884e-51ccceed1dc0 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:49.693418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ed95-7efb-4ffe-b1a3-6f530314cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:49.694008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ed95-7efb-4ffe-b1a3-6f530314cad6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:49.694282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ed95-7efb-4ffe-b1a3-6f530314cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:49.694598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ed95-7efb-4ffe-b1a3-6f530314cad6 None admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:49.695275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2ed95-7efb-4ffe-b1a3-6f530314cad6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:49.695577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2ed95-7efb-4ffe-b1a3-6f530314cad6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:49.696972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2ed95-7efb-4ffe-b1a3-6f530314cad6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:49.708891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 662/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Fri Sep 9 21:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:22:49.715627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:49.814407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb46d9f-e57a-4386-afa2-9c989a418ec9 None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:49.846315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c23722-8d56-4751-bb43-d969b03b50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:49.846911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c23722-8d56-4751-bb43-d969b03b50a4 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:49.847185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c23722-8d56-4751-bb43-d969b03b50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:49.847458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c23722-8d56-4751-bb43-d969b03b50a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:49.848784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c23722-8d56-4751-bb43-d969b03b50a4 None admin] RBAC: Adding query filter params (role.id=eea82d73b0db450f9f23e5256483a93e, scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5, user.id=fa725c2a086f4964acefdadb45cc88ef) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:49.849259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c23722-8d56-4751-bb43-d969b03b50a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:49.850711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c23722-8d56-4751-bb43-d969b03b50a4 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:49.856680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 625/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Fri Sep 9 21:22:49 2022] GET /identity/v3/role_assignments?user.id=fa725c2a086f4964acefdadb45cc88ef&scope.project.id=ea6bad538f2c4a8a937e26b80079a4e5&role.id=eea82d73b0db450f9f23e5256483a93e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:52.040073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ca60-a98c-466c-a888-0f27b42fa0b2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:52.040658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ca60-a98c-466c-a888-0f27b42fa0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:52.040658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ca60-a98c-466c-a888-0f27b42fa0b2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:52.042198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 663/1288] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:52.047570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5944-0c40-4eb9-a8a9-754e2fe73d96 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:52.048005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5944-0c40-4eb9-a8a9-754e2fe73d96 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:52.048110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5944-0c40-4eb9-a8a9-754e2fe73d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:52.066931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4f5c5944-0c40-4eb9-a8a9-754e2fe73d96 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:52.068135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4f5c5944-0c40-4eb9-a8a9-754e2fe73d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:52.096984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:52.133004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 626/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:52.398858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85ca60-a98c-466c-a888-0f27b42fa0b2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:52.498544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85ca60-a98c-466c-a888-0f27b42fa0b2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:52.509264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:52.530782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b39c8-b559-42f1-883b-54635974731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:52.531401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b39c8-b559-42f1-883b-54635974731e None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:52.531674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b39c8-b559-42f1-883b-54635974731e None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:52.531941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b39c8-b559-42f1-883b-54635974731e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:52.532512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b39c8-b559-42f1-883b-54635974731e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:52.533877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b39c8-b559-42f1-883b-54635974731e None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-334b39c8-b559-42f1-883b-54635974731e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:52.542676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:52.543924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:52.544785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 664/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:22:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:52.549955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5944-0c40-4eb9-a8a9-754e2fe73d96 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:52.648034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5944-0c40-4eb9-a8a9-754e2fe73d96 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:52.681949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010541-eb88-4f68-8531-4b160ccd9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:52.682488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010541-eb88-4f68-8531-4b160ccd9f10 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:52.682766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010541-eb88-4f68-8531-4b160ccd9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:52.683037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010541-eb88-4f68-8531-4b160ccd9f10 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:52.683659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010541-eb88-4f68-8531-4b160ccd9f10 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:52.683955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010541-eb88-4f68-8531-4b160ccd9f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:52.685334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010541-eb88-4f68-8531-4b160ccd9f10 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:52.690028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 627/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Sep 9 21:22:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:52.695900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b39c8-b559-42f1-883b-54635974731e None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:52.792835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b39c8-b559-42f1-883b-54635974731e None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:52.825559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8c86-29f4-460f-bd70-f82ae0f61a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:52.828438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8c86-29f4-460f-bd70-f82ae0f61a39 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:52.828438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8c86-29f4-460f-bd70-f82ae0f61a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:52.828438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8c86-29f4-460f-bd70-f82ae0f61a39 None admin] PATH_INFO: `/v3/services` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:52.828438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe8c86-29f4-460f-bd70-f82ae0f61a39 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:52.828438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe8c86-29f4-460f-bd70-f82ae0f61a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:52.828920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe8c86-29f4-460f-bd70-f82ae0f61a39 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:52.833279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 665/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Sep 9 21:22:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:54.998802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215844c-3f23-4824-8519-a2baa12c2501 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:54.999334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215844c-3f23-4824-8519-a2baa12c2501 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:54.999334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215844c-3f23-4824-8519-a2baa12c2501 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:55.000723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 628/1293] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:55.006776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921cdf-2e52-4aa0-a6e7-9a00c8f1a9a9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:55.007176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921cdf-2e52-4aa0-a6e7-9a00c8f1a9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:55.007321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921cdf-2e52-4aa0-a6e7-9a00c8f1a9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:55.026201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-40921cdf-2e52-4aa0-a6e7-9a00c8f1a9a9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:55.027527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-40921cdf-2e52-4aa0-a6e7-9a00c8f1a9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:55.056280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:55.093550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 666/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:55.369256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215844c-3f23-4824-8519-a2baa12c2501 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:55.399967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:55.470639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215844c-3f23-4824-8519-a2baa12c2501 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:55.502964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674185c-c298-4734-a52e-df9d22875838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:55.503558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674185c-c298-4734-a52e-df9d22875838 None admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:55.503834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674185c-c298-4734-a52e-df9d22875838 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:55.504775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674185c-c298-4734-a52e-df9d22875838 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:55.505464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674185c-c298-4734-a52e-df9d22875838 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:55.506815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674185c-c298-4734-a52e-df9d22875838 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:55.581428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 629/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Fri Sep 9 21:22:55 2022] POST /identity/v3/services => generated 246 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:22:57.737713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf5edc-9154-4813-9f5d-a251f13533af None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:57.738742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf5edc-9154-4813-9f5d-a251f13533af None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:57.738883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf5edc-9154-4813-9f5d-a251f13533af None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:57.740686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 667/1296] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:22:57.745849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139f11b-a5b7-45fa-814d-73e7e3b6a034 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:57.746255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139f11b-a5b7-45fa-814d-73e7e3b6a034 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:57.746932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139f11b-a5b7-45fa-814d-73e7e3b6a034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:57.765695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b139f11b-a5b7-45fa-814d-73e7e3b6a034 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:22:57.766944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b139f11b-a5b7-45fa-814d-73e7e3b6a034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:22:57.840764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 630/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:22:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 21:22:58.107500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf5edc-9154-4813-9f5d-a251f13533af None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:58.209731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf5edc-9154-4813-9f5d-a251f13533af None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:58.242965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:58.243590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:58.243881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:58.244143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:58.244719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:58.246101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:22:58.255331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:22:58.256606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:22:58.257673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 668/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:22:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 21:22:58.262616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139f11b-a5b7-45fa-814d-73e7e3b6a034 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:58.280471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:58.359332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139f11b-a5b7-45fa-814d-73e7e3b6a034 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:58.393812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:58.394409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:58.394736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:58.395002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:58.395620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:58.395912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:58.397292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:58.402244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 631/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Sep 9 21:22:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:58.408253 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:58.439318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:58.505314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ab512-4034-420a-a7cb-3db416464913 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:58.539022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a89c79-bb45-4985-84fe-75a2988a89ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:58.539630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a89c79-bb45-4985-84fe-75a2988a89ad None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:58.539909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a89c79-bb45-4985-84fe-75a2988a89ad None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:58.540181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a89c79-bb45-4985-84fe-75a2988a89ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:58.540878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a89c79-bb45-4985-84fe-75a2988a89ad None admin] RBAC: Adding query filter params (interface=public, service_id=99364abbfbf3472c83aeefe52b033d4a, region_id=RegionOne) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:22:58.541215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a89c79-bb45-4985-84fe-75a2988a89ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:58.542566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a89c79-bb45-4985-84fe-75a2988a89ad None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:58.547611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 669/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Fri Sep 9 21:22:58 2022] GET /identity/v3/endpoints?service_id=99364abbfbf3472c83aeefe52b033d4a&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:22:58.553941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:22:58.635336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:58.652895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad0dea-3058-461b-a499-c6c26eee470b None admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:22:58.689141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2b9a-9410-4c17-951c-46e599a35cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:22:58.689746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2b9a-9410-4c17-951c-46e599a35cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:22:58.690025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2b9a-9410-4c17-951c-46e599a35cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:22:58.690297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2b9a-9410-4c17-951c-46e599a35cb5 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:22:58.690900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e2b9a-9410-4c17-951c-46e599a35cb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:22:58.693371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e2b9a-9410-4c17-951c-46e599a35cb5 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:22:58.706341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 632/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Fri Sep 9 21:22:58 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:23:00.883988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e912-541f-4897-9539-4795abf93c27 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:23:00.884446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e912-541f-4897-9539-4795abf93c27 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:23:00.884556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e912-541f-4897-9539-4795abf93c27 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:23:00.886030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 670/1302] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:23:00.891277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac695-d19c-4bba-8091-f8f17ea1cf65 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:23:00.891772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac695-d19c-4bba-8091-f8f17ea1cf65 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:23:00.891906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac695-d19c-4bba-8091-f8f17ea1cf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:23:00.910031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b63ac695-d19c-4bba-8091-f8f17ea1cf65 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:23:00.914765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b63ac695-d19c-4bba-8091-f8f17ea1cf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:23:00.975181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 633/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:23:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 21:23:01.244756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6e912-541f-4897-9539-4795abf93c27 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:23:01.336803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:01.343179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6e912-541f-4897-9539-4795abf93c27 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:23:01.376192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:23:01.376808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:23:01.377112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:23:01.377384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:23:01.377955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:23:01.379936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 21:23:01.388487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 21:23:01.389702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application with Lock( Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self._enter() Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application return self.creator() Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application created_value = creator( Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: ERROR keystone.server.flask.application Sep 09 21:23:01.390882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 671/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Fri Sep 9 21:23:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 21:23:01.395683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac695-d19c-4bba-8091-f8f17ea1cf65 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:23:01.468466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:01.491515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac695-d19c-4bba-8091-f8f17ea1cf65 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:23:01.526277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4b3d0-8dc8-44b1-a0e3-48757678ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:23:01.526855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b3d0-8dc8-44b1-a0e3-48757678ef55 None admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:23:01.527138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b3d0-8dc8-44b1-a0e3-48757678ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:23:01.527414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b3d0-8dc8-44b1-a0e3-48757678ef55 None admin] PATH_INFO: `/v3/services` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:23:01.528040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4b3d0-8dc8-44b1-a0e3-48757678ef55 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:23:01.528374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4b3d0-8dc8-44b1-a0e3-48757678ef55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:23:01.529771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4b3d0-8dc8-44b1-a0e3-48757678ef55 None admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:23:01.534672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 634/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Fri Sep 9 21:23:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:23:01.541043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:23:01.639978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2818-5977-474c-8c79-53638e13e8b6 None admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:23:01.672440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72dc81-e2cb-428f-8b6d-c8bcc5700d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:23:01.673062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72dc81-e2cb-428f-8b6d-c8bcc5700d9d None admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:23:01.673402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72dc81-e2cb-428f-8b6d-c8bcc5700d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:23:01.673670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72dc81-e2cb-428f-8b6d-c8bcc5700d9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:23:01.674320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72dc81-e2cb-428f-8b6d-c8bcc5700d9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:23:01.676272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72dc81-e2cb-428f-8b6d-c8bcc5700d9d None admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:23:01.781190 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 672/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:23:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:23:11.544326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=30 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:11.776772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:17.194476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32b16d-84ee-499b-901c-944db8aadf2b None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:17.194943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32b16d-84ee-499b-901c-944db8aadf2b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:17.195024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32b16d-84ee-499b-901c-944db8aadf2b None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:17.196401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 635/1307] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:29:17.202751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34256ce8-1ec9-48e8-bf5c-30d09e115135 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:17.203210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34256ce8-1ec9-48e8-bf5c-30d09e115135 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:17.203557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34256ce8-1ec9-48e8-bf5c-30d09e115135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:17.345002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-34256ce8-1ec9-48e8-bf5c-30d09e115135 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:17.346254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-34256ce8-1ec9-48e8-bf5c-30d09e115135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:17.481568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 673/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:17.772869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6231f-e994-4311-9fab-acd1d1ca4168 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:17.773316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6231f-e994-4311-9fab-acd1d1ca4168 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:17.773680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6231f-e994-4311-9fab-acd1d1ca4168 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:17.775386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 636/1309] 10.222.0.60 () {54 vars in 965 bytes} [Fri Sep 9 21:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:17.782441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7497-81d0-497a-b0bc-3a8c6b0778b6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:17.782730 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7497-81d0-497a-b0bc-3a8c6b0778b6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:17.783247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7497-81d0-497a-b0bc-3a8c6b0778b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:17.879726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4b2c7497-81d0-497a-b0bc-3a8c6b0778b6 None None] MFA Rules not processed for user `cf39db40dace49cbba29c0596cbe76bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:17.881231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4b2c7497-81d0-497a-b0bc-3a8c6b0778b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:17.906009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:17.976151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 674/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Sep 9 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:17.986110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6231f-e994-4311-9fab-acd1d1ca4168 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:17.988281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9dc6231f-e994-4311-9fab-acd1d1ca4168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:18.120416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6231f-e994-4311-9fab-acd1d1ca4168 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:18.204160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3801958-8bd5-4af2-a46c-9481d7e84584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:18.204843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801958-8bd5-4af2-a46c-9481d7e84584 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:18.205051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801958-8bd5-4af2-a46c-9481d7e84584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:18.205326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801958-8bd5-4af2-a46c-9481d7e84584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:18.206924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b3801958-8bd5-4af2-a46c-9481d7e84584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:18.268321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:18.332545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3801958-8bd5-4af2-a46c-9481d7e84584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:18.334610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3801958-8bd5-4af2-a46c-9481d7e84584 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:18.357967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 637/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:20.867238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d999-0949-4445-9e86-6dad4839b352 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:20.867630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d999-0949-4445-9e86-6dad4839b352 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:20.867780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d999-0949-4445-9e86-6dad4839b352 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:20.869145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 675/1312] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:20.874307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904eeb6-fddb-4d62-8d35-f6de938eb7f2 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:20.874675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904eeb6-fddb-4d62-8d35-f6de938eb7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:20.874848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904eeb6-fddb-4d62-8d35-f6de938eb7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:20.946318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0904eeb6-fddb-4d62-8d35-f6de938eb7f2 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:20.947526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0904eeb6-fddb-4d62-8d35-f6de938eb7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:21.045914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 638/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:21.332476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d999-0949-4445-9e86-6dad4839b352 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:21.334763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6448d999-0949-4445-9e86-6dad4839b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:21.435881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d999-0949-4445-9e86-6dad4839b352 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:21.506462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:21.508533 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334e5cf-060a-4ff0-9ab7-c36ece6012a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:21.509165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e5cf-060a-4ff0-9ab7-c36ece6012a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:21.509446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e5cf-060a-4ff0-9ab7-c36ece6012a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:21.509719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e5cf-060a-4ff0-9ab7-c36ece6012a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:21.511293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8334e5cf-060a-4ff0-9ab7-c36ece6012a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:21.622233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e5cf-060a-4ff0-9ab7-c36ece6012a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:21.623582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e5cf-060a-4ff0-9ab7-c36ece6012a3 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:21.641704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 676/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:24.274528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4410bd-8cb2-497b-b5db-4ddbb749423e None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:24.275086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4410bd-8cb2-497b-b5db-4ddbb749423e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:24.275086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4410bd-8cb2-497b-b5db-4ddbb749423e None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:24.276429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 639/1315] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:24.282593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284df1e-cad1-43d1-b30d-ed330123578d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:24.283029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284df1e-cad1-43d1-b30d-ed330123578d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:24.283220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284df1e-cad1-43d1-b30d-ed330123578d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:24.351725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d284df1e-cad1-43d1-b30d-ed330123578d None None] MFA Rules not processed for user `2c7ddc5ee76a4a0f81bea1f3107dde6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:24.352936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d284df1e-cad1-43d1-b30d-ed330123578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:24.403258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:24.447438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 677/1316] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:24.736289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4410bd-8cb2-497b-b5db-4ddbb749423e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:24.737860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9e4410bd-8cb2-497b-b5db-4ddbb749423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:24.747682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:24.841459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4410bd-8cb2-497b-b5db-4ddbb749423e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:24.914417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ecfb8-58bd-4d62-8038-7bd176f9f366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:24.915015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ecfb8-58bd-4d62-8038-7bd176f9f366 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:24.915289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ecfb8-58bd-4d62-8038-7bd176f9f366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:24.915553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ecfb8-58bd-4d62-8038-7bd176f9f366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:24.917141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-811ecfb8-58bd-4d62-8038-7bd176f9f366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:24.980849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:25.026106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ecfb8-58bd-4d62-8038-7bd176f9f366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:25.027529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ecfb8-58bd-4d62-8038-7bd176f9f366 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:25.045265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 640/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:29:28.066815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abb780-0cc6-4f3a-a898-9647a1ea07f1 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:28.067400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abb780-0cc6-4f3a-a898-9647a1ea07f1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:28.067400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abb780-0cc6-4f3a-a898-9647a1ea07f1 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:28.068695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 678/1318] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:28.074037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd85c-7922-4c9b-922c-88d931eaf631 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:28.074500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd85c-7922-4c9b-922c-88d931eaf631 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:28.074604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd85c-7922-4c9b-922c-88d931eaf631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:28.138500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ad2cd85c-7922-4c9b-922c-88d931eaf631 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:28.139605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ad2cd85c-7922-4c9b-922c-88d931eaf631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:28.234828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 641/1319] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:28.540217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841254dd-69b9-4895-b75d-0907ab19ad92 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:28.540498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841254dd-69b9-4895-b75d-0907ab19ad92 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:28.540768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841254dd-69b9-4895-b75d-0907ab19ad92 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:28.542158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 679/1320] 10.222.0.60 () {54 vars in 965 bytes} [Fri Sep 9 21:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:28.547646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b63cb-dd1d-4cc4-961b-2cec8c2c45ac None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:28.547937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b63cb-dd1d-4cc4-961b-2cec8c2c45ac None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:28.548211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b63cb-dd1d-4cc4-961b-2cec8c2c45ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:28.571223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:28.625900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-696b63cb-dd1d-4cc4-961b-2cec8c2c45ac None None] MFA Rules not processed for user `cf39db40dace49cbba29c0596cbe76bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:28.627090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-696b63cb-dd1d-4cc4-961b-2cec8c2c45ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:28.701362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 642/1321] 10.222.0.60 () {58 vars in 1062 bytes} [Fri Sep 9 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:28.710717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841254dd-69b9-4895-b75d-0907ab19ad92 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:28.712224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-841254dd-69b9-4895-b75d-0907ab19ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:28.814029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841254dd-69b9-4895-b75d-0907ab19ad92 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:28.889601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0c2b6-a09c-4a35-8a2e-2593684a4409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:28.890258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0c2b6-a09c-4a35-8a2e-2593684a4409 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:28.890541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0c2b6-a09c-4a35-8a2e-2593684a4409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:28.890814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0c2b6-a09c-4a35-8a2e-2593684a4409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:28.892406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-80e0c2b6-a09c-4a35-8a2e-2593684a4409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:28.900082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:29.000995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0c2b6-a09c-4a35-8a2e-2593684a4409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:29.002435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0c2b6-a09c-4a35-8a2e-2593684a4409 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:29.020961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 680/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:32.585647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206f1a-9e7b-4b79-86f6-df5f61a6bd9a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:32.586211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206f1a-9e7b-4b79-86f6-df5f61a6bd9a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:32.586211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206f1a-9e7b-4b79-86f6-df5f61a6bd9a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:32.587551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 643/1323] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:32.592976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d2ca-ee6c-4caa-9bdb-9d7ef2d439ad None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:32.593456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d2ca-ee6c-4caa-9bdb-9d7ef2d439ad None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:32.593679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d2ca-ee6c-4caa-9bdb-9d7ef2d439ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:32.663857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cf01d2ca-ee6c-4caa-9bdb-9d7ef2d439ad None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:32.665076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cf01d2ca-ee6c-4caa-9bdb-9d7ef2d439ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:32.723617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:32.763288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 681/1324] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:33.054803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206f1a-9e7b-4b79-86f6-df5f61a6bd9a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:33.056312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-aa206f1a-9e7b-4b79-86f6-df5f61a6bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:33.161353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206f1a-9e7b-4b79-86f6-df5f61a6bd9a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:33.174130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:33.235378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076bb0e-75e2-4592-bf48-a26b23c72137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:33.235980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bb0e-75e2-4592-bf48-a26b23c72137 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:33.236252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bb0e-75e2-4592-bf48-a26b23c72137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:33.236515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076bb0e-75e2-4592-bf48-a26b23c72137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:33.238114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d076bb0e-75e2-4592-bf48-a26b23c72137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:33.346750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076bb0e-75e2-4592-bf48-a26b23c72137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:33.348220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076bb0e-75e2-4592-bf48-a26b23c72137 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:33.366943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 644/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:35.604982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380bf41-0131-4471-96af-771a897bb56a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:35.605619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380bf41-0131-4471-96af-771a897bb56a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:35.605619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380bf41-0131-4471-96af-771a897bb56a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:35.606820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 682/1326] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:35.612224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275ce8-3295-4609-8b49-46ae6d5a16a6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:35.612690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275ce8-3295-4609-8b49-46ae6d5a16a6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:35.612805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275ce8-3295-4609-8b49-46ae6d5a16a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:35.662817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:35.683958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6a275ce8-3295-4609-8b49-46ae6d5a16a6 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:35.685240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6a275ce8-3295-4609-8b49-46ae6d5a16a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:35.787323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 645/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:36.081494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380bf41-0131-4471-96af-771a897bb56a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:36.083092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6380bf41-0131-4471-96af-771a897bb56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:36.188223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380bf41-0131-4471-96af-771a897bb56a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:36.261394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36509-4510-438a-b80f-44f265aa6c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:36.262004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36509-4510-438a-b80f-44f265aa6c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:36.262276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36509-4510-438a-b80f-44f265aa6c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:36.262541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36509-4510-438a-b80f-44f265aa6c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:36.264103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5df36509-4510-438a-b80f-44f265aa6c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:36.280901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:36.375810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36509-4510-438a-b80f-44f265aa6c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:36.377261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36509-4510-438a-b80f-44f265aa6c56 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:36.395692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 683/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:38.628682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05025c-bada-4365-950b-96947ae3df54 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:38.629248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05025c-bada-4365-950b-96947ae3df54 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:38.629248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05025c-bada-4365-950b-96947ae3df54 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:38.630605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 646/1329] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:38.635970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5007c2-21a1-47f3-9f5e-042d585a6512 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:38.636391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5007c2-21a1-47f3-9f5e-042d585a6512 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:38.636520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5007c2-21a1-47f3-9f5e-042d585a6512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:38.701980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2c5007c2-21a1-47f3-9f5e-042d585a6512 None None] MFA Rules not processed for user `2c7ddc5ee76a4a0f81bea1f3107dde6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:38.703176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2c5007c2-21a1-47f3-9f5e-042d585a6512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:38.768384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:38.803102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 684/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:29:39.086839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05025c-bada-4365-950b-96947ae3df54 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:39.088404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7e05025c-bada-4365-950b-96947ae3df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:39.198184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05025c-bada-4365-950b-96947ae3df54 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:39.223516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:39.281287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd3d33-4e59-479e-9a1f-9c43840f4ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:39.281907 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd3d33-4e59-479e-9a1f-9c43840f4ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:39.282188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd3d33-4e59-479e-9a1f-9c43840f4ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:39.282459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd3d33-4e59-479e-9a1f-9c43840f4ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:39.284097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1bdd3d33-4e59-479e-9a1f-9c43840f4ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:39.404254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd3d33-4e59-479e-9a1f-9c43840f4ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:39.405736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd3d33-4e59-479e-9a1f-9c43840f4ab1 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:39.426335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 647/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:42.028627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385ab4c-8e1d-4b2a-b7f1-c624b701dc11 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:42.029187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385ab4c-8e1d-4b2a-b7f1-c624b701dc11 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:42.029187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385ab4c-8e1d-4b2a-b7f1-c624b701dc11 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:42.030546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 685/1332] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:42.036595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a690a-ecdd-432d-bb2b-18cb3daf2d09 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:42.037072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a690a-ecdd-432d-bb2b-18cb3daf2d09 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:42.037171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a690a-ecdd-432d-bb2b-18cb3daf2d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:42.100614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:42.103288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-661a690a-ecdd-432d-bb2b-18cb3daf2d09 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:42.104495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-661a690a-ecdd-432d-bb2b-18cb3daf2d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:42.200058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 648/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:42.486406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385ab4c-8e1d-4b2a-b7f1-c624b701dc11 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:42.487923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7385ab4c-8e1d-4b2a-b7f1-c624b701dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:42.588526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385ab4c-8e1d-4b2a-b7f1-c624b701dc11 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:42.659736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738157b2-726b-4eb9-bd33-b62a6ed76763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:42.660899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738157b2-726b-4eb9-bd33-b62a6ed76763 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:42.661208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738157b2-726b-4eb9-bd33-b62a6ed76763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:42.661476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738157b2-726b-4eb9-bd33-b62a6ed76763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:42.663048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-738157b2-726b-4eb9-bd33-b62a6ed76763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:42.689442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:42.770365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738157b2-726b-4eb9-bd33-b62a6ed76763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:42.771710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738157b2-726b-4eb9-bd33-b62a6ed76763 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:42.789779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 686/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:44.979603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409554-6730-408c-af5a-4f5777d00b07 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:44.980169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409554-6730-408c-af5a-4f5777d00b07 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:44.980169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409554-6730-408c-af5a-4f5777d00b07 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:44.981505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 649/1335] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:44.986630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514eff-2fa5-4c7c-a0f2-61b5039909dd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:44.987049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514eff-2fa5-4c7c-a0f2-61b5039909dd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:44.987218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514eff-2fa5-4c7c-a0f2-61b5039909dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:45.052809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-40514eff-2fa5-4c7c-a0f2-61b5039909dd None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:45.053973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-40514eff-2fa5-4c7c-a0f2-61b5039909dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:45.127408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:45.264340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 687/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:45.547243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a409554-6730-408c-af5a-4f5777d00b07 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:45.548760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0a409554-6730-408c-af5a-4f5777d00b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:45.650423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a409554-6730-408c-af5a-4f5777d00b07 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:45.678738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:45.725151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d2499-2ece-4710-8df6-77e1f207ccb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:45.725749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2499-2ece-4710-8df6-77e1f207ccb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:45.726020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2499-2ece-4710-8df6-77e1f207ccb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:45.726347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2499-2ece-4710-8df6-77e1f207ccb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:45.727843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-202d2499-2ece-4710-8df6-77e1f207ccb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:45.834168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d2499-2ece-4710-8df6-77e1f207ccb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:45.835511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d2499-2ece-4710-8df6-77e1f207ccb2 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:45.854118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 650/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:48.715062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b694-628a-47b6-88e3-fd50d08762f3 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:48.715621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b694-628a-47b6-88e3-fd50d08762f3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:48.715621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b694-628a-47b6-88e3-fd50d08762f3 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:48.716939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 688/1338] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:48.722230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6718-a8aa-4754-901d-e64b83923275 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:48.722646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6718-a8aa-4754-901d-e64b83923275 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:48.722777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6718-a8aa-4754-901d-e64b83923275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:48.789536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8cca6718-a8aa-4754-901d-e64b83923275 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:48.790733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8cca6718-a8aa-4754-901d-e64b83923275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:48.799221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:48.891607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 651/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:49.176094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b694-628a-47b6-88e3-fd50d08762f3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:49.178354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1434b694-628a-47b6-88e3-fd50d08762f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:49.281898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b694-628a-47b6-88e3-fd50d08762f3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:49.361744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0483-580f-4989-aa99-b3aca48cfa53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:49.362355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0483-580f-4989-aa99-b3aca48cfa53 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:49.362631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0483-580f-4989-aa99-b3aca48cfa53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:49.362901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0483-580f-4989-aa99-b3aca48cfa53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:49.364522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-846a0483-580f-4989-aa99-b3aca48cfa53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:49.404549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:49.479279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0483-580f-4989-aa99-b3aca48cfa53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:49.480700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0483-580f-4989-aa99-b3aca48cfa53 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:49.498350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 689/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:53.890847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d44d6-56c2-4460-8937-841235c64855 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:53.890847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d44d6-56c2-4460-8937-841235c64855 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:53.891324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d44d6-56c2-4460-8937-841235c64855 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:53.892428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 652/1341] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:53.898717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e0df1-0426-48fa-aad5-026d268fcbd8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:53.899159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e0df1-0426-48fa-aad5-026d268fcbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:53.899237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e0df1-0426-48fa-aad5-026d268fcbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:53.968229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-746e0df1-0426-48fa-aad5-026d268fcbd8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:53.969455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-746e0df1-0426-48fa-aad5-026d268fcbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:54.054485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:54.065907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 690/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:54.350173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d44d6-56c2-4460-8937-841235c64855 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:54.351680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f96d44d6-56c2-4460-8937-841235c64855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:54.456876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d44d6-56c2-4460-8937-841235c64855 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:54.496174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:54.532789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fff38-9fcc-4515-bc37-afcf55272c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:54.533432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fff38-9fcc-4515-bc37-afcf55272c3a service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:54.533714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fff38-9fcc-4515-bc37-afcf55272c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:54.533986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fff38-9fcc-4515-bc37-afcf55272c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:54.535636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d41fff38-9fcc-4515-bc37-afcf55272c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:54.649086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fff38-9fcc-4515-bc37-afcf55272c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:54.650441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fff38-9fcc-4515-bc37-afcf55272c3a service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:54.669557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 653/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:29:57.758477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19385e00-1e1b-4f73-a876-7ec04eb02930 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:57.759071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19385e00-1e1b-4f73-a876-7ec04eb02930 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:57.759071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19385e00-1e1b-4f73-a876-7ec04eb02930 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:57.760344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 691/1344] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:29:57.765506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49708e-7fe8-4e61-9974-da8ef38347ba None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:57.765935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49708e-7fe8-4e61-9974-da8ef38347ba None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:57.766037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49708e-7fe8-4e61-9974-da8ef38347ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:57.832106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ca49708e-7fe8-4e61-9974-da8ef38347ba None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:29:57.834067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ca49708e-7fe8-4e61-9974-da8ef38347ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:57.853951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:57.938540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 654/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:29:58.229311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19385e00-1e1b-4f73-a876-7ec04eb02930 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:29:58.231002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-19385e00-1e1b-4f73-a876-7ec04eb02930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:58.338196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19385e00-1e1b-4f73-a876-7ec04eb02930 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:29:58.415426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2564e85-e075-4347-a108-1abefea40731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:29:58.416072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2564e85-e075-4347-a108-1abefea40731 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:29:58.416249 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2564e85-e075-4347-a108-1abefea40731 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:29:58.416493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2564e85-e075-4347-a108-1abefea40731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:29:58.418119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f2564e85-e075-4347-a108-1abefea40731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:29:58.463931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:58.532646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2564e85-e075-4347-a108-1abefea40731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:29:58.534135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2564e85-e075-4347-a108-1abefea40731 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:29:58.552881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 692/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:29:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:03.013625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12faa7-bb81-4722-be65-2a90da5062f2 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:03.014155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12faa7-bb81-4722-be65-2a90da5062f2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:03.014155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12faa7-bb81-4722-be65-2a90da5062f2 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:03.016596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 655/1347] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:03.024715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d780-7ef4-4dbf-89e0-2c61db269c23 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:03.025272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d780-7ef4-4dbf-89e0-2c61db269c23 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:03.025272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d780-7ef4-4dbf-89e0-2c61db269c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:03.105974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-16b7d780-7ef4-4dbf-89e0-2c61db269c23 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:03.107198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-16b7d780-7ef4-4dbf-89e0-2c61db269c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:03.215222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:03.220770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 693/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:03.523568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12faa7-bb81-4722-be65-2a90da5062f2 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:03.525125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9c12faa7-bb81-4722-be65-2a90da5062f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:03.630508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12faa7-bb81-4722-be65-2a90da5062f2 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:03.678089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:03.703457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdbd85-3a09-495d-ac2e-22a1b2acb765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:03.712260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdbd85-3a09-495d-ac2e-22a1b2acb765 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:03.712260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdbd85-3a09-495d-ac2e-22a1b2acb765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:03.712260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdbd85-3a09-495d-ac2e-22a1b2acb765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:03.712260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d4bdbd85-3a09-495d-ac2e-22a1b2acb765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:03.816152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdbd85-3a09-495d-ac2e-22a1b2acb765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:03.818256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdbd85-3a09-495d-ac2e-22a1b2acb765 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:03.836644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 656/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:08.890171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66d182-69da-422e-9795-fde3d958ec22 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:08.890681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66d182-69da-422e-9795-fde3d958ec22 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:08.890793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66d182-69da-422e-9795-fde3d958ec22 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:08.892214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 694/1350] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:08.898853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535111-098d-465b-b5fb-5a6fbadb9dd6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:08.900131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535111-098d-465b-b5fb-5a6fbadb9dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:08.900549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a535111-098d-465b-b5fb-5a6fbadb9dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:09.049815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2a535111-098d-465b-b5fb-5a6fbadb9dd6 None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:09.050959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2a535111-098d-465b-b5fb-5a6fbadb9dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:09.090723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:09.233444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 657/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:30:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:13.473610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cdc1-86e7-4be6-85fc-4dd0080dd044 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:13.474489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cdc1-86e7-4be6-85fc-4dd0080dd044 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:13.474925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cdc1-86e7-4be6-85fc-4dd0080dd044 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:13.476676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 695/1352] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:13.482014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fdcb-78e7-427e-bdd6-1725a6b461f0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:13.482825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fdcb-78e7-427e-bdd6-1725a6b461f0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:13.483330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fdcb-78e7-427e-bdd6-1725a6b461f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:13.574047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fc26fdcb-78e7-427e-bdd6-1725a6b461f0 None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:13.575736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fc26fdcb-78e7-427e-bdd6-1725a6b461f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:13.656491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:13.702528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 658/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:30:15.338934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9086736-6284-4907-b2db-f59d6f046338 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:15.339426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9086736-6284-4907-b2db-f59d6f046338 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:15.339543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9086736-6284-4907-b2db-f59d6f046338 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:15.341050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 696/1354] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:15.346509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615687-82e6-4f26-b04d-5f799d7bb462 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:15.347016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615687-82e6-4f26-b04d-5f799d7bb462 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:15.348457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615687-82e6-4f26-b04d-5f799d7bb462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:15.438484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9b615687-82e6-4f26-b04d-5f799d7bb462 None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:15.439732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9b615687-82e6-4f26-b04d-5f799d7bb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:15.554162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 659/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:18.884315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92af6-07d6-445a-941c-6758823a52a9 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:18.884868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92af6-07d6-445a-941c-6758823a52a9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:18.885908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92af6-07d6-445a-941c-6758823a52a9 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:18.888204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 697/1356] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:18.894750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ce13d-d617-44b5-b7f9-137a513da3e0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:18.895822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ce13d-d617-44b5-b7f9-137a513da3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:18.896243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ce13d-d617-44b5-b7f9-137a513da3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:18.953510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:18.998606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1e5ce13d-d617-44b5-b7f9-137a513da3e0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:18.998606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1e5ce13d-d617-44b5-b7f9-137a513da3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:19.099871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 660/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:19.420257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b1509-0b22-42f2-8cd0-e21294e20d19 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:19.420999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b1509-0b22-42f2-8cd0-e21294e20d19 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:19.421517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b1509-0b22-42f2-8cd0-e21294e20d19 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:19.423451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 698/1358] 10.222.0.60 () {54 vars in 962 bytes} [Fri Sep 9 21:30:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:19.440017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c731e-f9f4-47d3-b31c-30cebf21e586 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:19.440308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c731e-f9f4-47d3-b31c-30cebf21e586 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:19.445367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c731e-f9f4-47d3-b31c-30cebf21e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:19.546636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-245c731e-f9f4-47d3-b31c-30cebf21e586 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:19.546636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-245c731e-f9f4-47d3-b31c-30cebf21e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:19.595662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:19.671397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 661/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Sep 9 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:19.680540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b1509-0b22-42f2-8cd0-e21294e20d19 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:19.682104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-746b1509-0b22-42f2-8cd0-e21294e20d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:19.857126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b1509-0b22-42f2-8cd0-e21294e20d19 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:19.933073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:19.981512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62de56-89d4-4025-86b1-ca40a15d70b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:19.982274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62de56-89d4-4025-86b1-ca40a15d70b8 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:19.982656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62de56-89d4-4025-86b1-ca40a15d70b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:19.983027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62de56-89d4-4025-86b1-ca40a15d70b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:19.984757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ed62de56-89d4-4025-86b1-ca40a15d70b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:20.096923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62de56-89d4-4025-86b1-ca40a15d70b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:20.098575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62de56-89d4-4025-86b1-ca40a15d70b8 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:20.118979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 699/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:30:22.528640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6cf3-6679-4d1c-ac49-add1d5971596 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:22.528640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6cf3-6679-4d1c-ac49-add1d5971596 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:22.528640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6cf3-6679-4d1c-ac49-add1d5971596 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:22.531140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 662/1361] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:22.535473 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd050-cc9f-4cdf-a815-6bba980492c0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:22.536040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd050-cc9f-4cdf-a815-6bba980492c0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:22.536222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd050-cc9f-4cdf-a815-6bba980492c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:22.608265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fb6dd050-cc9f-4cdf-a815-6bba980492c0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:22.609536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fb6dd050-cc9f-4cdf-a815-6bba980492c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:22.648334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:22.715376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 700/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:23.008107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc6cf3-6679-4d1c-ac49-add1d5971596 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:23.011032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a2fc6cf3-6679-4d1c-ac49-add1d5971596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:23.204143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc6cf3-6679-4d1c-ac49-add1d5971596 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:23.216199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:23.339837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9575d-dde1-43d1-b037-3c8f097ec59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:23.340390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9575d-dde1-43d1-b037-3c8f097ec59c service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:23.340663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9575d-dde1-43d1-b037-3c8f097ec59c service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:23.340929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9575d-dde1-43d1-b037-3c8f097ec59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:23.342537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-01c9575d-dde1-43d1-b037-3c8f097ec59c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:23.438342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9575d-dde1-43d1-b037-3c8f097ec59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:23.439913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9575d-dde1-43d1-b037-3c8f097ec59c service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:23.458900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 663/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:26.077764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e36ae8-3648-4acb-932f-7434da29ed1a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:26.078286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e36ae8-3648-4acb-932f-7434da29ed1a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:26.078286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e36ae8-3648-4acb-932f-7434da29ed1a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:26.080710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 701/1364] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:26.085295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612d68-eda0-40b7-9754-1fc232bbec8c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:26.085765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612d68-eda0-40b7-9754-1fc232bbec8c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:26.085875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612d68-eda0-40b7-9754-1fc232bbec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:26.101811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:26.158825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-da612d68-eda0-40b7-9754-1fc232bbec8c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:26.160926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-da612d68-eda0-40b7-9754-1fc232bbec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:26.269550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 664/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:26.558288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c6411-e9cc-4e3e-a681-ac577d60f90f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:26.558578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c6411-e9cc-4e3e-a681-ac577d60f90f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:26.558857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c6411-e9cc-4e3e-a681-ac577d60f90f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:26.560303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 702/1366] 10.222.0.60 () {54 vars in 962 bytes} [Fri Sep 9 21:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:26.565893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077502-5c1a-477b-ad4a-be37fc4d51cd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:26.566225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077502-5c1a-477b-ad4a-be37fc4d51cd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:26.566845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077502-5c1a-477b-ad4a-be37fc4d51cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:26.653812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5d077502-5c1a-477b-ad4a-be37fc4d51cd None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:26.655455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5d077502-5c1a-477b-ad4a-be37fc4d51cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:26.694094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:26.788335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 665/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Sep 9 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:26.792135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c6411-e9cc-4e3e-a681-ac577d60f90f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:26.793749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-639c6411-e9cc-4e3e-a681-ac577d60f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:26.969819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c6411-e9cc-4e3e-a681-ac577d60f90f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:26.992192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:27.137216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2818b-a509-4b2f-9d5c-f120389a6672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:27.137216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2818b-a509-4b2f-9d5c-f120389a6672 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:27.137216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2818b-a509-4b2f-9d5c-f120389a6672 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:27.137216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2818b-a509-4b2f-9d5c-f120389a6672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:27.138237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4aa2818b-a509-4b2f-9d5c-f120389a6672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:27.184024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4748-cc3c-48c9-a258-8727d60e3516 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:27.184592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4748-cc3c-48c9-a258-8727d60e3516 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:27.184592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4748-cc3c-48c9-a258-8727d60e3516 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:27.186082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 666/1368] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:30:27.192064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc411a5-c27b-4d02-b9bf-93c18006a729 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:27.192346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc411a5-c27b-4d02-b9bf-93c18006a729 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:27.192608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc411a5-c27b-4d02-b9bf-93c18006a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:27.223272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2818b-a509-4b2f-9d5c-f120389a6672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:27.224860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2818b-a509-4b2f-9d5c-f120389a6672 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:27.244554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 703/1369] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:30:27.264923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0dc411a5-c27b-4d02-b9bf-93c18006a729 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:27.266356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0dc411a5-c27b-4d02-b9bf-93c18006a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:27.369986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:27.386697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 667/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:27.731240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7a2e-8ab9-4a8f-be06-b82dbc43ba03 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:27.731240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7a2e-8ab9-4a8f-be06-b82dbc43ba03 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:27.731240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7a2e-8ab9-4a8f-be06-b82dbc43ba03 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:27.736213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 704/1371] 10.222.0.60 () {54 vars in 964 bytes} [Fri Sep 9 21:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:27.738821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058537f0-d18b-495e-8f53-eae18e73c768 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:27.739178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058537f0-d18b-495e-8f53-eae18e73c768 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:27.739518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058537f0-d18b-495e-8f53-eae18e73c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:27.829221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-058537f0-d18b-495e-8f53-eae18e73c768 None None] MFA Rules not processed for user `1852c201959444ca8066470206aa6167`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:27.830469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-058537f0-d18b-495e-8f53-eae18e73c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:27.926670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 668/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Sep 9 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:27.934589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7a2e-8ab9-4a8f-be06-b82dbc43ba03 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:27.936113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-206f7a2e-8ab9-4a8f-be06-b82dbc43ba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:27.968965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:28.055247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7a2e-8ab9-4a8f-be06-b82dbc43ba03 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:28.141209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d554a0-994a-4790-966e-1d7168709de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:28.141821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d554a0-994a-4790-966e-1d7168709de3 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:28.142099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d554a0-994a-4790-966e-1d7168709de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:28.142369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d554a0-994a-4790-966e-1d7168709de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:28.144529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b8d554a0-994a-4790-966e-1d7168709de3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:28.225289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:28.266457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d554a0-994a-4790-966e-1d7168709de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:28.267880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d554a0-994a-4790-966e-1d7168709de3 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:28.290898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 705/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:30:29.664645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff317-4779-408e-aa17-d69534344a19 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:29.665302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff317-4779-408e-aa17-d69534344a19 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:29.665302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff317-4779-408e-aa17-d69534344a19 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:29.671717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6f4ad-ffe1-472f-9c59-0a91219d799d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:29.672165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6f4ad-ffe1-472f-9c59-0a91219d799d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:29.672264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6f4ad-ffe1-472f-9c59-0a91219d799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:29.676124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 669/1374] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:29.744836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-64c6f4ad-ffe1-472f-9c59-0a91219d799d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:29.746216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-64c6f4ad-ffe1-472f-9c59-0a91219d799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:29.852148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 706/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:30:30.142498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff317-4779-408e-aa17-d69534344a19 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:30.144605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-54bff317-4779-408e-aa17-d69534344a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:30.255315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:30.332611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff317-4779-408e-aa17-d69534344a19 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:30.464476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296fc1-fa84-45dd-a90d-1baac06b9596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:30.465122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296fc1-fa84-45dd-a90d-1baac06b9596 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:30.465400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296fc1-fa84-45dd-a90d-1baac06b9596 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:30.465680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296fc1-fa84-45dd-a90d-1baac06b9596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:30.467801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a8296fc1-fa84-45dd-a90d-1baac06b9596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:30.539179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:30.594142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296fc1-fa84-45dd-a90d-1baac06b9596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:30.595834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296fc1-fa84-45dd-a90d-1baac06b9596 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:30.621056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 670/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:33.086211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557e0e-0ac6-42f1-b8da-701b66f4cec0 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:33.086690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557e0e-0ac6-42f1-b8da-701b66f4cec0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:33.086690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557e0e-0ac6-42f1-b8da-701b66f4cec0 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:33.091937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 707/1377] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:33.093336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7aa5-f735-410a-8fef-f97f30c1939f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:33.093740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7aa5-f735-410a-8fef-f97f30c1939f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:33.093906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7aa5-f735-410a-8fef-f97f30c1939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:33.194408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-55fe7aa5-f735-410a-8fef-f97f30c1939f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:33.196827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-55fe7aa5-f735-410a-8fef-f97f30c1939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:33.311948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 671/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:33.609953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557e0e-0ac6-42f1-b8da-701b66f4cec0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:33.611434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0557e0e-0ac6-42f1-b8da-701b66f4cec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:33.665896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:33.804891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557e0e-0ac6-42f1-b8da-701b66f4cec0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:33.949377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:33.957624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab9c10-40c6-40d1-bd18-8798c3d06161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:33.958236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab9c10-40c6-40d1-bd18-8798c3d06161 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:33.958513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab9c10-40c6-40d1-bd18-8798c3d06161 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:33.958783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab9c10-40c6-40d1-bd18-8798c3d06161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:33.960375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-61ab9c10-40c6-40d1-bd18-8798c3d06161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:34.074188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab9c10-40c6-40d1-bd18-8798c3d06161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:34.076385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab9c10-40c6-40d1-bd18-8798c3d06161 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:34.102447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 708/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:36.541971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9d9fd-23d2-4cf3-8a6f-0abb1bffeab5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:36.542466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9d9fd-23d2-4cf3-8a6f-0abb1bffeab5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:36.542658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9d9fd-23d2-4cf3-8a6f-0abb1bffeab5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:36.543994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 672/1380] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:36.549354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed729cb9-f2fa-49d7-ad24-a00002ac43d7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:36.550004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed729cb9-f2fa-49d7-ad24-a00002ac43d7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:36.550004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed729cb9-f2fa-49d7-ad24-a00002ac43d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:36.690755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ed729cb9-f2fa-49d7-ad24-a00002ac43d7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:36.691856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ed729cb9-f2fa-49d7-ad24-a00002ac43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:36.781320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:36.826839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 709/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:37.139840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9d9fd-23d2-4cf3-8a6f-0abb1bffeab5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:37.141508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-efa9d9fd-23d2-4cf3-8a6f-0abb1bffeab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:37.175709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:37.335676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9d9fd-23d2-4cf3-8a6f-0abb1bffeab5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:37.471723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:37.491553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef08128-2950-4688-8584-e2d6a3cddd2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:37.492641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef08128-2950-4688-8584-e2d6a3cddd2a service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:37.493560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef08128-2950-4688-8584-e2d6a3cddd2a service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:37.494414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef08128-2950-4688-8584-e2d6a3cddd2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:37.496536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5ef08128-2950-4688-8584-e2d6a3cddd2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:37.625356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef08128-2950-4688-8584-e2d6a3cddd2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:37.628200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef08128-2950-4688-8584-e2d6a3cddd2a service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:37.647056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 673/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:40.280508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74cdb5-626d-4d1c-8682-c1bf0182f348 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:40.281020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74cdb5-626d-4d1c-8682-c1bf0182f348 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:40.281131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74cdb5-626d-4d1c-8682-c1bf0182f348 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:40.282822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 710/1383] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:40.289763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb4dd-ed68-4f91-b2b2-9fc2b749feac None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:40.290299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb4dd-ed68-4f91-b2b2-9fc2b749feac None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:40.290299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb4dd-ed68-4f91-b2b2-9fc2b749feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:40.369487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9b1eb4dd-ed68-4f91-b2b2-9fc2b749feac None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:40.370666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9b1eb4dd-ed68-4f91-b2b2-9fc2b749feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:40.443744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:40.486091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 674/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:30:40.859836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74cdb5-626d-4d1c-8682-c1bf0182f348 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:40.861538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f74cdb5-626d-4d1c-8682-c1bf0182f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:41.013798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74cdb5-626d-4d1c-8682-c1bf0182f348 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:41.070402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:41.140569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cb61-1b5d-4ad1-b156-6cabe6e55da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:41.141307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cb61-1b5d-4ad1-b156-6cabe6e55da4 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:41.141672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cb61-1b5d-4ad1-b156-6cabe6e55da4 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:41.142005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cb61-1b5d-4ad1-b156-6cabe6e55da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:41.144676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dfb0cb61-1b5d-4ad1-b156-6cabe6e55da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:41.256680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0cb61-1b5d-4ad1-b156-6cabe6e55da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:41.258374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0cb61-1b5d-4ad1-b156-6cabe6e55da4 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:41.276582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 711/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:43.436674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81921-a18e-4c2a-9da5-d5b651c99ba5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:43.437519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81921-a18e-4c2a-9da5-d5b651c99ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:43.437519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb81921-a18e-4c2a-9da5-d5b651c99ba5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:43.438860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 675/1386] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:43.445434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94e00-471f-47b8-8b1b-0f87287bc2ba None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:43.445846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94e00-471f-47b8-8b1b-0f87287bc2ba None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:43.446019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94e00-471f-47b8-8b1b-0f87287bc2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:43.513957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5ce94e00-471f-47b8-8b1b-0f87287bc2ba None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:43.515167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5ce94e00-471f-47b8-8b1b-0f87287bc2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:43.523578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:43.613243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 712/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:43.906207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb81921-a18e-4c2a-9da5-d5b651c99ba5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:43.907809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ccb81921-a18e-4c2a-9da5-d5b651c99ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:44.057504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb81921-a18e-4c2a-9da5-d5b651c99ba5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:44.104839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:44.172803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50301d12-3678-44b8-b033-db639d163826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:44.173363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301d12-3678-44b8-b033-db639d163826 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:44.175481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301d12-3678-44b8-b033-db639d163826 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:44.175763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301d12-3678-44b8-b033-db639d163826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:44.177403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-50301d12-3678-44b8-b033-db639d163826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:44.270119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301d12-3678-44b8-b033-db639d163826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:44.271823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301d12-3678-44b8-b033-db639d163826 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:44.290050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 676/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:44.529259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6606c4-a2e5-43bf-bcd0-9043bbbf9394 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:44.529811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6606c4-a2e5-43bf-bcd0-9043bbbf9394 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:44.529811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6606c4-a2e5-43bf-bcd0-9043bbbf9394 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:44.531264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 713/1389] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:44.537751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a947-0a0f-4157-8ea9-8cc2af739c17 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:44.538335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a947-0a0f-4157-8ea9-8cc2af739c17 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:44.538335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a947-0a0f-4157-8ea9-8cc2af739c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:44.610064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:44.614009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0fa9a947-0a0f-4157-8ea9-8cc2af739c17 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:44.615268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0fa9a947-0a0f-4157-8ea9-8cc2af739c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:44.719425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 677/1390] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:45.026705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2e463-1c5b-4b2a-8a2e-62156c353cd1 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:45.026986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2e463-1c5b-4b2a-8a2e-62156c353cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:45.027254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2e463-1c5b-4b2a-8a2e-62156c353cd1 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:45.036510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 714/1391] 10.222.0.60 () {54 vars in 966 bytes} [Fri Sep 9 21:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:30:45.036654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4afb8-d81e-4bb8-a439-dad311e38894 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:45.036654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4afb8-d81e-4bb8-a439-dad311e38894 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:45.036654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4afb8-d81e-4bb8-a439-dad311e38894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:45.112847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f8f4afb8-d81e-4bb8-a439-dad311e38894 None None] MFA Rules not processed for user `3d284f9dd17546208bc48aa269c56fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:45.113995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f8f4afb8-d81e-4bb8-a439-dad311e38894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:45.186385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:45.193125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 678/1392] 10.222.0.60 () {58 vars in 1063 bytes} [Fri Sep 9 21:30:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:45.204115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2e463-1c5b-4b2a-8a2e-62156c353cd1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:45.205687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cdc2e463-1c5b-4b2a-8a2e-62156c353cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:45.309804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2e463-1c5b-4b2a-8a2e-62156c353cd1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:45.349510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:45.389770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66934-5b27-4321-adef-c0627d9f6b33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:45.390293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66934-5b27-4321-adef-c0627d9f6b33 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:45.390571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66934-5b27-4321-adef-c0627d9f6b33 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:45.390841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66934-5b27-4321-adef-c0627d9f6b33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:45.393072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-54e66934-5b27-4321-adef-c0627d9f6b33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:45.504370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66934-5b27-4321-adef-c0627d9f6b33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:45.505954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66934-5b27-4321-adef-c0627d9f6b33 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:45.524660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 715/1393] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:30:46.419157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683add89-d1ce-4169-a68d-e4409a0153a7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:46.419627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683add89-d1ce-4169-a68d-e4409a0153a7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:46.419830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683add89-d1ce-4169-a68d-e4409a0153a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:46.488690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-683add89-d1ce-4169-a68d-e4409a0153a7 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:46.489915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-683add89-d1ce-4169-a68d-e4409a0153a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:46.581877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 679/1394] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:30:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:46.626144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6cde-dd19-4376-adfe-200ab0da8e8d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:46.627138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6cde-dd19-4376-adfe-200ab0da8e8d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:46.627551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6cde-dd19-4376-adfe-200ab0da8e8d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:46.628929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 716/1395] 10.222.0.60 () {54 vars in 943 bytes} [Fri Sep 9 21:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:46.635968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7caf67-21e0-4300-9a0a-d07d99f38278 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:46.636248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7caf67-21e0-4300-9a0a-d07d99f38278 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:46.636524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7caf67-21e0-4300-9a0a-d07d99f38278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:46.650172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23179-19d4-452b-a9a4-f0f529a9aabd None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:46.650452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23179-19d4-452b-a9a4-f0f529a9aabd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:46.650724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23179-19d4-452b-a9a4-f0f529a9aabd None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:46.652033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 717/1396] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:30:46.656806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:46.657179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:46.657538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:46.715983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-dc7caf67-21e0-4300-9a0a-d07d99f38278 None None] MFA Rules not processed for user `ed6b146dd405411db127d9668822cbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:46.717252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dc7caf67-21e0-4300-9a0a-d07d99f38278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:46.724992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:46.726208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:46.743573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:46.744149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:46.824073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 680/1397] 10.222.0.60 () {58 vars in 1040 bytes} [Fri Sep 9 21:30:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:46.834434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 718/1398] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:30:46.835791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7caf67-21e0-4300-9a0a-d07d99f38278 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:46.843502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7caf67-21e0-4300-9a0a-d07d99f38278 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:46.950066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c13528-74da-406f-ae38-0a35f286b0f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:46.950668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13528-74da-406f-ae38-0a35f286b0f7 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:46.950945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13528-74da-406f-ae38-0a35f286b0f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:46.951213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13528-74da-406f-ae38-0a35f286b0f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:46.952826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-25c13528-74da-406f-ae38-0a35f286b0f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:46.986716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:47.036967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c13528-74da-406f-ae38-0a35f286b0f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:47.038582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c13528-74da-406f-ae38-0a35f286b0f7 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:47.046704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 681/1399] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 21:30:47.118870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:47.120056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:47.234995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6497e-cda9-490d-b5fd-134f8cd30930 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:47.275361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:47.353093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8401f-3b74-4dc9-9975-091ce06833bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:47.353702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8401f-3b74-4dc9-9975-091ce06833bd service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:47.353977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8401f-3b74-4dc9-9975-091ce06833bd service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:47.354244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8401f-3b74-4dc9-9975-091ce06833bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:47.355821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9cf8401f-3b74-4dc9-9975-091ce06833bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:47.473678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8401f-3b74-4dc9-9975-091ce06833bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:47.475374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8401f-3b74-4dc9-9975-091ce06833bd service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:47.495811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 719/1400] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:50.010767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb5b7-00e0-4cbb-8b09-c94e9d37a097 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:50.011392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb5b7-00e0-4cbb-8b09-c94e9d37a097 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:50.011392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb5b7-00e0-4cbb-8b09-c94e9d37a097 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:50.012675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 682/1401] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:50.018012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30324-ec62-44a9-8a29-799473110dca None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:50.018440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30324-ec62-44a9-8a29-799473110dca None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:50.018594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30324-ec62-44a9-8a29-799473110dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:50.070156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:50.091105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dbc30324-ec62-44a9-8a29-799473110dca None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:50.092342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dbc30324-ec62-44a9-8a29-799473110dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:50.199859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 720/1402] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:50.488744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb5b7-00e0-4cbb-8b09-c94e9d37a097 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:50.490291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ef7fb5b7-00e0-4cbb-8b09-c94e9d37a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:50.661015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb5b7-00e0-4cbb-8b09-c94e9d37a097 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:50.691390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:50.788385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887e243-6cc8-4b96-bdbb-217a2b4626da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:50.789261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e243-6cc8-4b96-bdbb-217a2b4626da service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:50.789541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e243-6cc8-4b96-bdbb-217a2b4626da service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:50.789813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e243-6cc8-4b96-bdbb-217a2b4626da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:50.791404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c887e243-6cc8-4b96-bdbb-217a2b4626da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:50.891550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887e243-6cc8-4b96-bdbb-217a2b4626da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:50.893826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887e243-6cc8-4b96-bdbb-217a2b4626da service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:50.913535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 683/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:53.270466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098bd8d-d905-4648-8e17-022ac1e6677d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:53.271147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098bd8d-d905-4648-8e17-022ac1e6677d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:53.271147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098bd8d-d905-4648-8e17-022ac1e6677d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:53.276551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 721/1404] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:53.278458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539ba1d-d570-4b77-a1c3-123c6c01dc75 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:53.278941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539ba1d-d570-4b77-a1c3-123c6c01dc75 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:53.283605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539ba1d-d570-4b77-a1c3-123c6c01dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:53.335960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:53.368440 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0539ba1d-d570-4b77-a1c3-123c6c01dc75 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:53.369694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0539ba1d-d570-4b77-a1c3-123c6c01dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:53.493138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 684/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:30:53.786037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098bd8d-d905-4648-8e17-022ac1e6677d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:53.787756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b098bd8d-d905-4648-8e17-022ac1e6677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:53.935950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:53.971559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098bd8d-d905-4648-8e17-022ac1e6677d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:54.098735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984378b-9f8f-431d-b7f2-bc6702c86dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:54.099633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984378b-9f8f-431d-b7f2-bc6702c86dad service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:54.100059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984378b-9f8f-431d-b7f2-bc6702c86dad service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:54.100483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984378b-9f8f-431d-b7f2-bc6702c86dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:54.102286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d984378b-9f8f-431d-b7f2-bc6702c86dad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:54.192437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:54.206017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984378b-9f8f-431d-b7f2-bc6702c86dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:54.208448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984378b-9f8f-431d-b7f2-bc6702c86dad service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:54.231228 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 722/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:30:56.700674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289d7b4-3641-42bd-93ec-25a2b87dcaff None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:56.701250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289d7b4-3641-42bd-93ec-25a2b87dcaff None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:56.701250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289d7b4-3641-42bd-93ec-25a2b87dcaff None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:56.702782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 685/1407] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:30:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:30:56.709843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3c63d-f2ff-47a4-876d-0519cdfde63e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:56.710282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3c63d-f2ff-47a4-876d-0519cdfde63e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:56.710433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3c63d-f2ff-47a4-876d-0519cdfde63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:56.788750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-40f3c63d-f2ff-47a4-876d-0519cdfde63e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:30:56.790125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-40f3c63d-f2ff-47a4-876d-0519cdfde63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:56.901856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 723/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:30:57.193298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289d7b4-3641-42bd-93ec-25a2b87dcaff None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:30:57.194655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4289d7b4-3641-42bd-93ec-25a2b87dcaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:57.320758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:57.368967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289d7b4-3641-42bd-93ec-25a2b87dcaff None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:30:57.495833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171904-1fc0-4098-bdf3-ac7f362752c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:30:57.496567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171904-1fc0-4098-bdf3-ac7f362752c1 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:30:57.496858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171904-1fc0-4098-bdf3-ac7f362752c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:30:57.497164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171904-1fc0-4098-bdf3-ac7f362752c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:30:57.498776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f9171904-1fc0-4098-bdf3-ac7f362752c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:30:57.587132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:57.605056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9171904-1fc0-4098-bdf3-ac7f362752c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:30:57.606955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9171904-1fc0-4098-bdf3-ac7f362752c1 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:30:57.627493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 686/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:06.900182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=74 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:07.624913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=13 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:11.005369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51fe09-dfcf-4d34-aaeb-2af514624b5b None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:11.005917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51fe09-dfcf-4d34-aaeb-2af514624b5b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:11.005917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51fe09-dfcf-4d34-aaeb-2af514624b5b None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:11.007276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 724/1410] 10.222.0.60 () {54 vars in 918 bytes} [Fri Sep 9 21:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:11.012985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc74a9-abb1-4d91-942e-4d396690c38e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:11.013703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc74a9-abb1-4d91-942e-4d396690c38e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:11.013905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc74a9-abb1-4d91-942e-4d396690c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:11.090606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-43bc74a9-abb1-4d91-942e-4d396690c38e None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:11.091804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-43bc74a9-abb1-4d91-942e-4d396690c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:11.199114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 687/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Sep 9 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:11.214201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19ec08-457f-4087-9623-7de24d801238 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:11.214486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19ec08-457f-4087-9623-7de24d801238 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:11.214771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19ec08-457f-4087-9623-7de24d801238 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:11.216167 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 725/1412] 10.222.0.60 () {54 vars in 918 bytes} [Fri Sep 9 21:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:11.220779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff198d5-befa-4c44-9a4a-18205d610e14 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:11.221091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff198d5-befa-4c44-9a4a-18205d610e14 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:11.221365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff198d5-befa-4c44-9a4a-18205d610e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:11.292017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:11.294989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6ff198d5-befa-4c44-9a4a-18205d610e14 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:11.296205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6ff198d5-befa-4c44-9a4a-18205d610e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:11.410830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 688/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Fri Sep 9 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:13.993557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59550f4-958e-4678-be0e-fc5a20ea2a7c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:13.994126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59550f4-958e-4678-be0e-fc5a20ea2a7c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:13.994126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59550f4-958e-4678-be0e-fc5a20ea2a7c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:13.995456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 726/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:14.000837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058937-7687-454c-9c38-b061b16d3961 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:14.001300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058937-7687-454c-9c38-b061b16d3961 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:14.001419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83058937-7687-454c-9c38-b061b16d3961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:14.071276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-83058937-7687-454c-9c38-b061b16d3961 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:14.072411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-83058937-7687-454c-9c38-b061b16d3961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:14.129288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:14.172889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 689/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:14.460384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59550f4-958e-4678-be0e-fc5a20ea2a7c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:14.461976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f59550f4-958e-4678-be0e-fc5a20ea2a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:14.607587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59550f4-958e-4678-be0e-fc5a20ea2a7c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:14.679745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:14.718662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1efae-be34-4398-a232-fc2c6275c6dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:14.719260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1efae-be34-4398-a232-fc2c6275c6dd service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:14.719556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1efae-be34-4398-a232-fc2c6275c6dd service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:14.719819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1efae-be34-4398-a232-fc2c6275c6dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:14.721415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9bd1efae-be34-4398-a232-fc2c6275c6dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:14.807345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1efae-be34-4398-a232-fc2c6275c6dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:14.808904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1efae-be34-4398-a232-fc2c6275c6dd service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:14.826800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 727/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:15.967006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baf6fd-1556-438d-b2d8-012526b47c48 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:15.967541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baf6fd-1556-438d-b2d8-012526b47c48 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:15.971992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baf6fd-1556-438d-b2d8-012526b47c48 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:15.971992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 690/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:15.975318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a25d4-e789-48f5-9ffb-82ed63e5bb77 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:15.975793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a25d4-e789-48f5-9ffb-82ed63e5bb77 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:15.975903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a25d4-e789-48f5-9ffb-82ed63e5bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:16.051056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f52a25d4-e789-48f5-9ffb-82ed63e5bb77 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:16.052264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f52a25d4-e789-48f5-9ffb-82ed63e5bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:16.079244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:16.147304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 728/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:16.304849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baf6fd-1556-438d-b2d8-012526b47c48 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:16.306113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-65baf6fd-1556-438d-b2d8-012526b47c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:16.453524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baf6fd-1556-438d-b2d8-012526b47c48 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:16.493427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:16.565490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ea549-45ab-4566-8566-91c45ace9a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:16.566119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea549-45ab-4566-8566-91c45ace9a68 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:16.566393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea549-45ab-4566-8566-91c45ace9a68 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:16.566662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea549-45ab-4566-8566-91c45ace9a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:16.568248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-270ea549-45ab-4566-8566-91c45ace9a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:16.657242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ea549-45ab-4566-8566-91c45ace9a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:16.659344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ea549-45ab-4566-8566-91c45ace9a68 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:16.678267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 691/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:17.805640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26de692-6432-4a47-b443-8b8c735dc247 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:17.806186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26de692-6432-4a47-b443-8b8c735dc247 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:17.806279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26de692-6432-4a47-b443-8b8c735dc247 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:17.807636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 729/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:17.814068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed398c-f4ed-435c-866a-981c48967c58 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:17.814601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed398c-f4ed-435c-866a-981c48967c58 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:17.814601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed398c-f4ed-435c-866a-981c48967c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:17.869672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:17.890528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c4ed398c-f4ed-435c-866a-981c48967c58 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:17.891762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c4ed398c-f4ed-435c-866a-981c48967c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:17.986105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 692/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:18.139949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26de692-6432-4a47-b443-8b8c735dc247 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:18.141413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d26de692-6432-4a47-b443-8b8c735dc247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:18.287719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26de692-6432-4a47-b443-8b8c735dc247 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:18.299563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:18.400714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc092ba-c78f-47ba-8981-b7a5e1c87ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:18.401263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc092ba-c78f-47ba-8981-b7a5e1c87ef8 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:18.401543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc092ba-c78f-47ba-8981-b7a5e1c87ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:18.401813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc092ba-c78f-47ba-8981-b7a5e1c87ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:18.403403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-abc092ba-c78f-47ba-8981-b7a5e1c87ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:18.491595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc092ba-c78f-47ba-8981-b7a5e1c87ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:18.493203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc092ba-c78f-47ba-8981-b7a5e1c87ef8 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:18.510731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 730/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:19.663662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60148c-b1a1-4c16-9766-f239319ef3cb None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:19.664219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60148c-b1a1-4c16-9766-f239319ef3cb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:19.664219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60148c-b1a1-4c16-9766-f239319ef3cb None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:19.665504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 693/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:19.671698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f9fe-aa17-471f-bb56-e55e4e85a1b7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:19.672151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f9fe-aa17-471f-bb56-e55e4e85a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:19.672272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f9fe-aa17-471f-bb56-e55e4e85a1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:19.692744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:19.755302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a523f9fe-aa17-471f-bb56-e55e4e85a1b7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:19.756502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a523f9fe-aa17-471f-bb56-e55e4e85a1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:19.852111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 731/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:20.004394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60148c-b1a1-4c16-9766-f239319ef3cb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:20.005976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3a60148c-b1a1-4c16-9766-f239319ef3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:20.117771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:20.153620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60148c-b1a1-4c16-9766-f239319ef3cb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:20.264773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202c28a-ed3d-4e93-81b0-5fe0199ab072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:20.265328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c28a-ed3d-4e93-81b0-5fe0199ab072 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:20.265607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c28a-ed3d-4e93-81b0-5fe0199ab072 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:20.265876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c28a-ed3d-4e93-81b0-5fe0199ab072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:20.267458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0202c28a-ed3d-4e93-81b0-5fe0199ab072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:20.345311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:20.358664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202c28a-ed3d-4e93-81b0-5fe0199ab072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:20.360280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202c28a-ed3d-4e93-81b0-5fe0199ab072 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:20.378910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 694/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:21.495942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4704-f979-4e72-be3f-b625da8c670d None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:21.496523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4704-f979-4e72-be3f-b625da8c670d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:21.496523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4704-f979-4e72-be3f-b625da8c670d None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:21.497874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 732/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:21.504489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4917da-0b54-42c8-9b07-18028d97a23d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:21.504946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4917da-0b54-42c8-9b07-18028d97a23d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:21.505075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4917da-0b54-42c8-9b07-18028d97a23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:21.581518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5d4917da-0b54-42c8-9b07-18028d97a23d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:21.582730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5d4917da-0b54-42c8-9b07-18028d97a23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:21.687368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 695/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:21.840458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4704-f979-4e72-be3f-b625da8c670d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:21.841911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e7de4704-f979-4e72-be3f-b625da8c670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:21.927129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:21.990857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4704-f979-4e72-be3f-b625da8c670d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:22.102066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f943e8-54a3-451b-9423-202bc8d5d23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:22.102602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f943e8-54a3-451b-9423-202bc8d5d23f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:22.102880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f943e8-54a3-451b-9423-202bc8d5d23f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:22.103146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f943e8-54a3-451b-9423-202bc8d5d23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:22.104728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-65f943e8-54a3-451b-9423-202bc8d5d23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:22.153169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:22.194442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f943e8-54a3-451b-9423-202bc8d5d23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:22.196065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f943e8-54a3-451b-9423-202bc8d5d23f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:22.214486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 733/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:23.323609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581557-ec27-445a-a85c-3d3c59167a30 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:23.324192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581557-ec27-445a-a85c-3d3c59167a30 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:23.324192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581557-ec27-445a-a85c-3d3c59167a30 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:23.325544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 696/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:23.332278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cc206-78a8-49cf-974f-c74aacecb9dc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:23.332696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cc206-78a8-49cf-974f-c74aacecb9dc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:23.332820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cc206-78a8-49cf-974f-c74aacecb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:23.407421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4b4cc206-78a8-49cf-974f-c74aacecb9dc None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:23.408669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4b4cc206-78a8-49cf-974f-c74aacecb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:23.506655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 734/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:23.657545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581557-ec27-445a-a85c-3d3c59167a30 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:23.659143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-06581557-ec27-445a-a85c-3d3c59167a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:23.709988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:23.806130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581557-ec27-445a-a85c-3d3c59167a30 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:23.918524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0b575-7448-4853-a105-f7fbb34f560f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:23.919080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0b575-7448-4853-a105-f7fbb34f560f service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:23.919355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0b575-7448-4853-a105-f7fbb34f560f service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:23.919626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0b575-7448-4853-a105-f7fbb34f560f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:23.921366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-91b0b575-7448-4853-a105-f7fbb34f560f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:23.928823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:24.011972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0b575-7448-4853-a105-f7fbb34f560f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:24.013597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0b575-7448-4853-a105-f7fbb34f560f service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:24.036988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 697/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:25.140062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb22aa-7e99-4d99-b431-fcb811a5151a None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:25.140509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb22aa-7e99-4d99-b431-fcb811a5151a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:25.140605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb22aa-7e99-4d99-b431-fcb811a5151a None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:25.141985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 735/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:25.148458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcba8-37f0-47d0-9dd6-79f12cc658b5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:25.148896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcba8-37f0-47d0-9dd6-79f12cc658b5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:25.149051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcba8-37f0-47d0-9dd6-79f12cc658b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:25.225258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d61dcba8-37f0-47d0-9dd6-79f12cc658b5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:25.226459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d61dcba8-37f0-47d0-9dd6-79f12cc658b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:25.293042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:25.323995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 698/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:25.471993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb22aa-7e99-4d99-b431-fcb811a5151a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:25.473527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-47bb22aa-7e99-4d99-b431-fcb811a5151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:25.491514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:25.617916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb22aa-7e99-4d99-b431-fcb811a5151a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:25.703302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:25.728112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4fe9b-57de-4774-b10d-21e5b6adb17f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:25.728644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4fe9b-57de-4774-b10d-21e5b6adb17f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:25.728918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4fe9b-57de-4774-b10d-21e5b6adb17f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:25.729215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4fe9b-57de-4774-b10d-21e5b6adb17f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:25.730783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ffb4fe9b-57de-4774-b10d-21e5b6adb17f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:25.821098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4fe9b-57de-4774-b10d-21e5b6adb17f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:25.822674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4fe9b-57de-4774-b10d-21e5b6adb17f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:25.840469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 736/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:26.942842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a802-9f6e-4565-82bf-987c6fbe03ba None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:26.943362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a802-9f6e-4565-82bf-987c6fbe03ba None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:26.943362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a802-9f6e-4565-82bf-987c6fbe03ba None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:26.944724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 699/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:26.950874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dcdcf-1e62-4299-a4ff-154d93399a8a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:26.951277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dcdcf-1e62-4299-a4ff-154d93399a8a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:26.951396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dcdcf-1e62-4299-a4ff-154d93399a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:27.028768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a77dcdcf-1e62-4299-a4ff-154d93399a8a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:27.030015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a77dcdcf-1e62-4299-a4ff-154d93399a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:27.074261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:27.128269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 737/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:27.277461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873a802-9f6e-4565-82bf-987c6fbe03ba None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:27.278977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d873a802-9f6e-4565-82bf-987c6fbe03ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:27.424402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873a802-9f6e-4565-82bf-987c6fbe03ba None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:27.477878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:27.536340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd162-354c-4820-a777-336756add64e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:27.536941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd162-354c-4820-a777-336756add64e service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:27.537243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd162-354c-4820-a777-336756add64e service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:27.537518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd162-354c-4820-a777-336756add64e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:27.539085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1f6fd162-354c-4820-a777-336756add64e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:27.624911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd162-354c-4820-a777-336756add64e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:27.626537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd162-354c-4820-a777-336756add64e service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:27.645393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 700/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:28.755848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243194e1-9360-4349-a9f9-ff84e6da2033 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:28.756443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243194e1-9360-4349-a9f9-ff84e6da2033 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:28.756443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243194e1-9360-4349-a9f9-ff84e6da2033 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:28.757810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 738/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:28.764124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d7b7c-c182-41c9-92ad-062b6d110fd1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:28.764558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d7b7c-c182-41c9-92ad-062b6d110fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:28.764653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d7b7c-c182-41c9-92ad-062b6d110fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:28.839656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-739d7b7c-c182-41c9-92ad-062b6d110fd1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:28.840845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-739d7b7c-c182-41c9-92ad-062b6d110fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:28.842882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:28.939571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 701/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:29.088303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243194e1-9360-4349-a9f9-ff84e6da2033 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:29.089763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-243194e1-9360-4349-a9f9-ff84e6da2033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:29.236324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243194e1-9360-4349-a9f9-ff84e6da2033 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:29.263751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:29.348540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64683d41-d42a-45ae-b7f3-44a10b4cca93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:29.349106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64683d41-d42a-45ae-b7f3-44a10b4cca93 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:29.349387 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64683d41-d42a-45ae-b7f3-44a10b4cca93 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:29.349657 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64683d41-d42a-45ae-b7f3-44a10b4cca93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:29.351236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-64683d41-d42a-45ae-b7f3-44a10b4cca93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:29.440431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64683d41-d42a-45ae-b7f3-44a10b4cca93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:29.442099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64683d41-d42a-45ae-b7f3-44a10b4cca93 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:29.460400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 739/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:31.523360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834f41-a51e-4576-96b0-95abe62b77c4 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:31.523960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834f41-a51e-4576-96b0-95abe62b77c4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:31.523960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834f41-a51e-4576-96b0-95abe62b77c4 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:31.525266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 702/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:31.530502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cbdc-d534-4482-935d-eebca21872da None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:31.530904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cbdc-d534-4482-935d-eebca21872da None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:31.531046 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cbdc-d534-4482-935d-eebca21872da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:31.574051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:31.599967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-69d0cbdc-d534-4482-935d-eebca21872da None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:31.601211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-69d0cbdc-d534-4482-935d-eebca21872da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:31.698796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 740/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:31.988248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36834f41-a51e-4576-96b0-95abe62b77c4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:31.989827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-36834f41-a51e-4576-96b0-95abe62b77c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:32.094267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36834f41-a51e-4576-96b0-95abe62b77c4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:32.127316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:32.168457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef949-4e30-43aa-b3a5-2be16cec70cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:32.169093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef949-4e30-43aa-b3a5-2be16cec70cc service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:32.169367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef949-4e30-43aa-b3a5-2be16cec70cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:32.169632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef949-4e30-43aa-b3a5-2be16cec70cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:32.171195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2f9ef949-4e30-43aa-b3a5-2be16cec70cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:32.279159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef949-4e30-43aa-b3a5-2be16cec70cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:32.280599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef949-4e30-43aa-b3a5-2be16cec70cc service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:32.298049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 703/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:34.663718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61fa1-c11c-467f-a82a-f23a53c92c85 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:34.664289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61fa1-c11c-467f-a82a-f23a53c92c85 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:34.664289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61fa1-c11c-467f-a82a-f23a53c92c85 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:34.665671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 741/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:34.671089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffabdc-c0e5-4512-be69-c642d0369984 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:34.671477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffabdc-c0e5-4512-be69-c642d0369984 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:34.671640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffabdc-c0e5-4512-be69-c642d0369984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:34.739278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-86ffabdc-c0e5-4512-be69-c642d0369984 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:34.740470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-86ffabdc-c0e5-4512-be69-c642d0369984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:34.754332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:34.838904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 704/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:35.131803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61fa1-c11c-467f-a82a-f23a53c92c85 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:35.133390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29a61fa1-c11c-467f-a82a-f23a53c92c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:35.237065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61fa1-c11c-467f-a82a-f23a53c92c85 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:35.249836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:35.310888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70278654-b25c-4271-a3dc-5ed8ab8f4d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:35.311487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70278654-b25c-4271-a3dc-5ed8ab8f4d5a service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:35.311764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70278654-b25c-4271-a3dc-5ed8ab8f4d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:35.312032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70278654-b25c-4271-a3dc-5ed8ab8f4d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:35.313629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-70278654-b25c-4271-a3dc-5ed8ab8f4d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:35.422178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70278654-b25c-4271-a3dc-5ed8ab8f4d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:35.424153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70278654-b25c-4271-a3dc-5ed8ab8f4d5a service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:35.442171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 742/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:38.022614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22ad0-8015-43a3-9739-4cea57dbb0e5 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:38.023165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22ad0-8015-43a3-9739-4cea57dbb0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:38.023165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22ad0-8015-43a3-9739-4cea57dbb0e5 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:38.024513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 705/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:38.029835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc25a5f-8a69-4676-ac54-c40d99998bf4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:38.030212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc25a5f-8a69-4676-ac54-c40d99998bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:38.030440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc25a5f-8a69-4676-ac54-c40d99998bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:38.078036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:38.097051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0bc25a5f-8a69-4676-ac54-c40d99998bf4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:38.098266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0bc25a5f-8a69-4676-ac54-c40d99998bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:38.194894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 743/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:38.478369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22ad0-8015-43a3-9739-4cea57dbb0e5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:38.479962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9cc22ad0-8015-43a3-9739-4cea57dbb0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:38.585254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22ad0-8015-43a3-9739-4cea57dbb0e5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:38.625299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:38.660693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8c7d3-c616-44a4-a1e2-8ce3cad0f3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:38.661329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8c7d3-c616-44a4-a1e2-8ce3cad0f3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:38.661629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8c7d3-c616-44a4-a1e2-8ce3cad0f3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:38.661953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8c7d3-c616-44a4-a1e2-8ce3cad0f3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:38.663537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d9a8c7d3-c616-44a4-a1e2-8ce3cad0f3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:38.775448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8c7d3-c616-44a4-a1e2-8ce3cad0f3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:38.776871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8c7d3-c616-44a4-a1e2-8ce3cad0f3f2 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:38.794965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 706/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:41.069434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc013-34b5-41ac-a237-4813374de241 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:41.069965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc013-34b5-41ac-a237-4813374de241 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:41.069965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc013-34b5-41ac-a237-4813374de241 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:41.071320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 744/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:41.076577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6adf37-e8df-44e9-9cd6-7467f9b5f1d3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:41.077012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6adf37-e8df-44e9-9cd6-7467f9b5f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:41.077171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6adf37-e8df-44e9-9cd6-7467f9b5f1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:41.143283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9e6adf37-e8df-44e9-9cd6-7467f9b5f1d3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:41.144406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9e6adf37-e8df-44e9-9cd6-7467f9b5f1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:41.166241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:41.241628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 707/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:41.527338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc013-34b5-41ac-a237-4813374de241 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:41.528859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-570bc013-34b5-41ac-a237-4813374de241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:41.630294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc013-34b5-41ac-a237-4813374de241 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:41.650992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:41.705189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6927f36-5f90-400f-a988-1adb5dd26cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:41.705543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927f36-5f90-400f-a988-1adb5dd26cba service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:41.705822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927f36-5f90-400f-a988-1adb5dd26cba service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:41.706090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927f36-5f90-400f-a988-1adb5dd26cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:41.707674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b6927f36-5f90-400f-a988-1adb5dd26cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:41.813240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6927f36-5f90-400f-a988-1adb5dd26cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:41.814701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6927f36-5f90-400f-a988-1adb5dd26cba service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:41.832475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 745/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:44.054956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e360973-8371-43e4-9349-26eba8fc22d6 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:44.055482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e360973-8371-43e4-9349-26eba8fc22d6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:44.055482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e360973-8371-43e4-9349-26eba8fc22d6 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:44.056849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 708/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:44.062402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674694-ef7b-46e4-ac15-5de62d9d0601 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:44.062850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674694-ef7b-46e4-ac15-5de62d9d0601 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:44.062958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674694-ef7b-46e4-ac15-5de62d9d0601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:44.127435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:44.129815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6d674694-ef7b-46e4-ac15-5de62d9d0601 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:44.131045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6d674694-ef7b-46e4-ac15-5de62d9d0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:44.227976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 746/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:44.513806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e360973-8371-43e4-9349-26eba8fc22d6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:44.515332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9e360973-8371-43e4-9349-26eba8fc22d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:44.619400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e360973-8371-43e4-9349-26eba8fc22d6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:44.668158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:44.691974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd91c-9539-43bd-a355-029fbe4119e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:44.692582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd91c-9539-43bd-a355-029fbe4119e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:44.692860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd91c-9539-43bd-a355-029fbe4119e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:44.701391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd91c-9539-43bd-a355-029fbe4119e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:44.701391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-097dd91c-9539-43bd-a355-029fbe4119e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:44.802162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd91c-9539-43bd-a355-029fbe4119e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:44.803539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd91c-9539-43bd-a355-029fbe4119e5 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:44.821190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 709/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:47.109189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739ddf-b692-4bf9-ab91-1e54d3d68af4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:47.109749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739ddf-b692-4bf9-ab91-1e54d3d68af4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:47.109749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6739ddf-b692-4bf9-ab91-1e54d3d68af4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:47.111149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 747/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:47.116563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c67f-a212-4390-8d5a-8ef0e267a006 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:47.116970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c67f-a212-4390-8d5a-8ef0e267a006 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:47.117146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c67f-a212-4390-8d5a-8ef0e267a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:47.183928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fd42c67f-a212-4390-8d5a-8ef0e267a006 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:47.185175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fd42c67f-a212-4390-8d5a-8ef0e267a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:47.214899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:47.282720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 710/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:47.567108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6739ddf-b692-4bf9-ab91-1e54d3d68af4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:47.568655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e6739ddf-b692-4bf9-ab91-1e54d3d68af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:47.669479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6739ddf-b692-4bf9-ab91-1e54d3d68af4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:47.698902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:47.743489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0552db-912a-45f4-a767-294bde18c10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:47.744086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0552db-912a-45f4-a767-294bde18c10a service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:47.744358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0552db-912a-45f4-a767-294bde18c10a service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:47.744622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0552db-912a-45f4-a767-294bde18c10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:47.746241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c0552db-912a-45f4-a767-294bde18c10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:47.852484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0552db-912a-45f4-a767-294bde18c10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:47.853940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0552db-912a-45f4-a767-294bde18c10a service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:47.872559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 748/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:50.075005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d298e-2e99-41ec-be28-07df1c86d4b6 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:50.075570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d298e-2e99-41ec-be28-07df1c86d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:50.075570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d298e-2e99-41ec-be28-07df1c86d4b6 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:50.076911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 711/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:50.082807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d19ef-2c97-4764-9556-b555f2e4ab28 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:50.083233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d19ef-2c97-4764-9556-b555f2e4ab28 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:50.083353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d19ef-2c97-4764-9556-b555f2e4ab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:50.150352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3e3d19ef-2c97-4764-9556-b555f2e4ab28 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:50.151470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3e3d19ef-2c97-4764-9556-b555f2e4ab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:50.159832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:50.249579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 749/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:50.533479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d298e-2e99-41ec-be28-07df1c86d4b6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:50.535057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7e3d298e-2e99-41ec-be28-07df1c86d4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:50.639549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d298e-2e99-41ec-be28-07df1c86d4b6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:50.694389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:50.712479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d5a20-4fce-4311-82bc-de9a4a2fc57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:50.713113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d5a20-4fce-4311-82bc-de9a4a2fc57b service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:50.720020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d5a20-4fce-4311-82bc-de9a4a2fc57b service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:50.720020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d5a20-4fce-4311-82bc-de9a4a2fc57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:50.720020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5e8d5a20-4fce-4311-82bc-de9a4a2fc57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:50.824027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d5a20-4fce-4311-82bc-de9a4a2fc57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:50.825408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d5a20-4fce-4311-82bc-de9a4a2fc57b service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:50.844443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 712/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:31:53.074087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026d9c-46a5-425e-93a2-c1453e97e13f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:53.074615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026d9c-46a5-425e-93a2-c1453e97e13f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:53.074727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026d9c-46a5-425e-93a2-c1453e97e13f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:53.076005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 750/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:53.082117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcdd06-8c31-408b-bdda-abb42f16163b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:53.082508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcdd06-8c31-408b-bdda-abb42f16163b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:53.082662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcdd06-8c31-408b-bdda-abb42f16163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:53.148276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3fbcdd06-8c31-408b-bdda-abb42f16163b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:53.149420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3fbcdd06-8c31-408b-bdda-abb42f16163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:53.187613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:53.246137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 713/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:53.532661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af026d9c-46a5-425e-93a2-c1453e97e13f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:53.534230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af026d9c-46a5-425e-93a2-c1453e97e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:53.637569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af026d9c-46a5-425e-93a2-c1453e97e13f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:53.675006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:53.711053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb175d-35ab-43c3-8804-17e3b724aeb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:53.711655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb175d-35ab-43c3-8804-17e3b724aeb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:53.711935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb175d-35ab-43c3-8804-17e3b724aeb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:53.712229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb175d-35ab-43c3-8804-17e3b724aeb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:53.715074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-efdb175d-35ab-43c3-8804-17e3b724aeb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:53.823507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb175d-35ab-43c3-8804-17e3b724aeb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:53.824849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb175d-35ab-43c3-8804-17e3b724aeb5 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:53.842806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 751/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:56.057244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aaf39-4f67-429b-be27-1ac9ee0f1978 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:56.057812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aaf39-4f67-429b-be27-1ac9ee0f1978 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:56.057812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aaf39-4f67-429b-be27-1ac9ee0f1978 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:56.059436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 714/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 21:31:56.066731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b3e3-2ccb-4e4a-8e55-7a2ace0226f7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:56.067201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b3e3-2ccb-4e4a-8e55-7a2ace0226f7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:56.067314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b3e3-2ccb-4e4a-8e55-7a2ace0226f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:56.134605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f410b3e3-2ccb-4e4a-8e55-7a2ace0226f7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:56.135743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f410b3e3-2ccb-4e4a-8e55-7a2ace0226f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:56.154304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:56.240331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 752/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:56.567492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aaf39-4f67-429b-be27-1ac9ee0f1978 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:56.569011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e19aaf39-4f67-429b-be27-1ac9ee0f1978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:56.790628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aaf39-4f67-429b-be27-1ac9ee0f1978 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:56.857519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:56.863878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6bc88-18cd-4e2d-9473-49f83fe3fd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:56.864493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6bc88-18cd-4e2d-9473-49f83fe3fd56 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:56.864769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6bc88-18cd-4e2d-9473-49f83fe3fd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:56.865056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6bc88-18cd-4e2d-9473-49f83fe3fd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:56.866642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b5b6bc88-18cd-4e2d-9473-49f83fe3fd56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:56.974977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6bc88-18cd-4e2d-9473-49f83fe3fd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:56.976518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6bc88-18cd-4e2d-9473-49f83fe3fd56 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:56.994520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 715/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:31:59.202599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdec7c-70f4-49ad-b13a-49fea1896ed2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:59.203125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdec7c-70f4-49ad-b13a-49fea1896ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:59.203125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdec7c-70f4-49ad-b13a-49fea1896ed2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:59.205227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 753/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:31:59.210942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf850c-8ecb-4575-a39f-deacea43f715 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:59.211413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf850c-8ecb-4575-a39f-deacea43f715 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:59.211517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf850c-8ecb-4575-a39f-deacea43f715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:59.277831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e0cf850c-8ecb-4575-a39f-deacea43f715 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:31:59.279108 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e0cf850c-8ecb-4575-a39f-deacea43f715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:59.327851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:59.374488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 716/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:31:59.656065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdec7c-70f4-49ad-b13a-49fea1896ed2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:31:59.658173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-43fdec7c-70f4-49ad-b13a-49fea1896ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:59.760997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdec7c-70f4-49ad-b13a-49fea1896ed2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:31:59.809720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:59.835277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a95b6-753b-4d03-8e1c-55d7c211c928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:31:59.835880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a95b6-753b-4d03-8e1c-55d7c211c928 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:31:59.836158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a95b6-753b-4d03-8e1c-55d7c211c928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:31:59.836432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a95b6-753b-4d03-8e1c-55d7c211c928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:31:59.838104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-330a95b6-753b-4d03-8e1c-55d7c211c928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:31:59.947865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a95b6-753b-4d03-8e1c-55d7c211c928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:31:59.952484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a95b6-753b-4d03-8e1c-55d7c211c928 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:31:59.971303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 754/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:32:09.377915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=22 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:09.969049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=66 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:20.138138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67229e-5724-46e4-98c5-09422c717666 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:20.138704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67229e-5724-46e4-98c5-09422c717666 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:20.138704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67229e-5724-46e4-98c5-09422c717666 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:20.140479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 717/1471] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:20.145840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ab7a-e321-4f22-abb6-fc3084362ed4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:20.146294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ab7a-e321-4f22-abb6-fc3084362ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:20.146411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ab7a-e321-4f22-abb6-fc3084362ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:20.211856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d5f2ab7a-e321-4f22-abb6-fc3084362ed4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:20.213083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d5f2ab7a-e321-4f22-abb6-fc3084362ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:20.308931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 755/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:20.619612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4de0-c404-47c0-829a-9311743beff7 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:20.619898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4de0-c404-47c0-829a-9311743beff7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:20.620197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a4de0-c404-47c0-829a-9311743beff7 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:20.621572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 718/1473] 10.222.0.60 () {54 vars in 966 bytes} [Fri Sep 9 21:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:20.626560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd0fa-10d9-4a01-92d2-06e94cd604f2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:20.626922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd0fa-10d9-4a01-92d2-06e94cd604f2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:20.627208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd0fa-10d9-4a01-92d2-06e94cd604f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:20.704113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5b4dd0fa-10d9-4a01-92d2-06e94cd604f2 None None] MFA Rules not processed for user `3d284f9dd17546208bc48aa269c56fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:20.705332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5b4dd0fa-10d9-4a01-92d2-06e94cd604f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:20.725791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:20.779486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 756/1474] 10.222.0.60 () {58 vars in 1063 bytes} [Fri Sep 9 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:20.787740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a4de0-c404-47c0-829a-9311743beff7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:32:20.789311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-212a4de0-c404-47c0-829a-9311743beff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:20.899206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a4de0-c404-47c0-829a-9311743beff7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:32:21.050036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fe1c4-ffdd-4a5b-a54e-d4e5fe0dd1f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:32:21.050662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fe1c4-ffdd-4a5b-a54e-d4e5fe0dd1f5 service glance] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:21.050942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fe1c4-ffdd-4a5b-a54e-d4e5fe0dd1f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:21.051212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fe1c4-ffdd-4a5b-a54e-d4e5fe0dd1f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:21.052856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6d4fe1c4-ffdd-4a5b-a54e-d4e5fe0dd1f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:21.109175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:21.167647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fe1c4-ffdd-4a5b-a54e-d4e5fe0dd1f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:32:21.169106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fe1c4-ffdd-4a5b-a54e-d4e5fe0dd1f5 service glance] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:32:21.188111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 719/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:32:23.423732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e4ced-187e-4347-ad69-9fb04795c482 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:23.424295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e4ced-187e-4347-ad69-9fb04795c482 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:23.424295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e4ced-187e-4347-ad69-9fb04795c482 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:23.425582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 757/1476] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:23.430847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a24b-eb62-4da5-8f62-640a53cca8f6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:23.431260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a24b-eb62-4da5-8f62-640a53cca8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:23.431389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a24b-eb62-4da5-8f62-640a53cca8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:23.496958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3aa9a24b-eb62-4da5-8f62-640a53cca8f6 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:23.498248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3aa9a24b-eb62-4da5-8f62-640a53cca8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:23.594076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 720/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:23.868314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e4ced-187e-4347-ad69-9fb04795c482 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:32:23.869886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9d2e4ced-187e-4347-ad69-9fb04795c482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:23.997610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e4ced-187e-4347-ad69-9fb04795c482 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:32:24.047295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:24.093021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597081d-39ab-4768-95e7-0f75957b1f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:32:24.093741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597081d-39ab-4768-95e7-0f75957b1f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:24.094020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597081d-39ab-4768-95e7-0f75957b1f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:24.094291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597081d-39ab-4768-95e7-0f75957b1f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:24.095002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597081d-39ab-4768-95e7-0f75957b1f35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:32:24.096660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-0597081d-39ab-4768-95e7-0f75957b1f35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:32:24.096660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:32:24.096660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:32:24.097857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597081d-39ab-4768-95e7-0f75957b1f35 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:32:24.117227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 758/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Fri Sep 9 21:32:23 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:32:26.305776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d007-fa9e-42a1-9a53-cf47e671fe61 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:26.306612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d007-fa9e-42a1-9a53-cf47e671fe61 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:26.306612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d007-fa9e-42a1-9a53-cf47e671fe61 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:26.307906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 721/1479] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:26.313205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692a84-56d8-4b80-bf1a-9e1131983c39 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:26.313621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692a84-56d8-4b80-bf1a-9e1131983c39 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:26.313765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49692a84-56d8-4b80-bf1a-9e1131983c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:26.378949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-49692a84-56d8-4b80-bf1a-9e1131983c39 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:26.380154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-49692a84-56d8-4b80-bf1a-9e1131983c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:26.479280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 759/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:26.771783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2d007-fa9e-42a1-9a53-cf47e671fe61 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:32:26.773320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f2c2d007-fa9e-42a1-9a53-cf47e671fe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:26.783068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:26.917134 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2d007-fa9e-42a1-9a53-cf47e671fe61 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:32:26.994634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:27.026520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffe64f-aa18-44bb-b94e-7177d74c72cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:32:27.027059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe64f-aa18-44bb-b94e-7177d74c72cf service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:27.027332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe64f-aa18-44bb-b94e-7177d74c72cf service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:27.027595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe64f-aa18-44bb-b94e-7177d74c72cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:27.029197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-beffe64f-aa18-44bb-b94e-7177d74c72cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:27.116590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffe64f-aa18-44bb-b94e-7177d74c72cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:32:27.118188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffe64f-aa18-44bb-b94e-7177d74c72cf service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:32:27.136174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 722/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:32:29.478706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3cd6e-735f-49ee-a63b-1245926f55e2 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:29.495296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3cd6e-735f-49ee-a63b-1245926f55e2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:29.495296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3cd6e-735f-49ee-a63b-1245926f55e2 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:29.495296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 760/1482] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:29.495613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc141f-e06d-48bd-bd6d-827ece932573 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:29.495613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc141f-e06d-48bd-bd6d-827ece932573 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:29.495613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc141f-e06d-48bd-bd6d-827ece932573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:29.552075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e7cc141f-e06d-48bd-bd6d-827ece932573 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:29.553371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e7cc141f-e06d-48bd-bd6d-827ece932573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:29.599666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:29.649395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 723/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:29.939544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3cd6e-735f-49ee-a63b-1245926f55e2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:32:29.941095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1af3cd6e-735f-49ee-a63b-1245926f55e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:29.964831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:30.044901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3cd6e-735f-49ee-a63b-1245926f55e2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:32:30.117494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d738-b272-413f-b1f1-dd219529a3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:32:30.118037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d738-b272-413f-b1f1-dd219529a3ea service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:30.118310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d738-b272-413f-b1f1-dd219529a3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:30.118576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d738-b272-413f-b1f1-dd219529a3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:30.120150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4139d738-b272-413f-b1f1-dd219529a3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:30.194836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:30.231484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d738-b272-413f-b1f1-dd219529a3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:32:30.233478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d738-b272-413f-b1f1-dd219529a3ea service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:32:30.254788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 761/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:32:32.511987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1380a0a-6329-4133-8d3e-3faadb51f366 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:32.512610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1380a0a-6329-4133-8d3e-3faadb51f366 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:32.512610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1380a0a-6329-4133-8d3e-3faadb51f366 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:32.514470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 724/1485] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:32.519823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7201-8468-4074-892c-0deb7d766927 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:32.520286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7201-8468-4074-892c-0deb7d766927 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:32.520394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb7201-8468-4074-892c-0deb7d766927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:32.586741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a0eb7201-8468-4074-892c-0deb7d766927 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:32.587938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a0eb7201-8468-4074-892c-0deb7d766927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:32.682419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 762/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:32.973742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1380a0a-6329-4133-8d3e-3faadb51f366 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:32:32.975300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a1380a0a-6329-4133-8d3e-3faadb51f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:33.078778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1380a0a-6329-4133-8d3e-3faadb51f366 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:32:33.149604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:33.151093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e1e4-28aa-44df-b65c-41c831819e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:32:33.151707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e1e4-28aa-44df-b65c-41c831819e6d service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:33.151987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e1e4-28aa-44df-b65c-41c831819e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:33.152258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e1e4-28aa-44df-b65c-41c831819e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:33.153894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-49e1e1e4-28aa-44df-b65c-41c831819e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:33.264601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e1e4-28aa-44df-b65c-41c831819e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:32:33.266119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e1e4-28aa-44df-b65c-41c831819e6d service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:32:33.284438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 725/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:32:35.577245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481f44-e970-4fa6-994f-9c87952b86c8 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:35.577831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481f44-e970-4fa6-994f-9c87952b86c8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:35.577831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481f44-e970-4fa6-994f-9c87952b86c8 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:35.578992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 763/1488] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:35.584290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb003-4110-4267-971b-a43b703606a8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:35.584730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb003-4110-4267-971b-a43b703606a8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:35.584836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb003-4110-4267-971b-a43b703606a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:35.649706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5f2fb003-4110-4267-971b-a43b703606a8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:35.650893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5f2fb003-4110-4267-971b-a43b703606a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:35.702287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:35.744408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 726/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:36.035528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481f44-e970-4fa6-994f-9c87952b86c8 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:32:36.037049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-aa481f44-e970-4fa6-994f-9c87952b86c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:36.072605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:36.144779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481f44-e970-4fa6-994f-9c87952b86c8 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:32:36.228803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f8eb4-c7a1-4a60-a23e-18657cff227e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:32:36.229472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8eb4-c7a1-4a60-a23e-18657cff227e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:36.229773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8eb4-c7a1-4a60-a23e-18657cff227e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:36.230049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8eb4-c7a1-4a60-a23e-18657cff227e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:36.231651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6c0f8eb4-c7a1-4a60-a23e-18657cff227e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:36.315867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:36.348653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8eb4-c7a1-4a60-a23e-18657cff227e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:32:36.350111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8eb4-c7a1-4a60-a23e-18657cff227e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:32:36.367593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 764/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:32:38.942706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990058-018a-44a3-be10-a4085b7b2f8e None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:38.943243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990058-018a-44a3-be10-a4085b7b2f8e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:38.943243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990058-018a-44a3-be10-a4085b7b2f8e None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:38.944647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 727/1491] 10.222.0.60 () {54 vars in 927 bytes} [Fri Sep 9 21:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:32:38.950013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84ee2f-dc39-4c43-b1d7-4d85ae73df93 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:38.950441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84ee2f-dc39-4c43-b1d7-4d85ae73df93 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:38.950596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84ee2f-dc39-4c43-b1d7-4d85ae73df93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:39.017826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8f84ee2f-dc39-4c43-b1d7-4d85ae73df93 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:32:39.019082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f84ee2f-dc39-4c43-b1d7-4d85ae73df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:39.117447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 765/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Fri Sep 9 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:32:39.408591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990058-018a-44a3-be10-a4085b7b2f8e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:32:39.410163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f8990058-018a-44a3-be10-a4085b7b2f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:39.515862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990058-018a-44a3-be10-a4085b7b2f8e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:32:39.590574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2830b14-c0a1-43e8-8c43-620a056f4e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:32:39.591784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830b14-c0a1-43e8-8c43-620a056f4e61 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:32:39.592055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830b14-c0a1-43e8-8c43-620a056f4e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:32:39.592320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830b14-c0a1-43e8-8c43-620a056f4e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:32:39.593925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f2830b14-c0a1-43e8-8c43-620a056f4e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:32:39.602933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:39.701493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2830b14-c0a1-43e8-8c43-620a056f4e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:32:39.702847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2830b14-c0a1-43e8-8c43-620a056f4e61 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:32:39.721119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 728/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:32:49.115832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:49.718917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=50 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:16.211333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:16.212021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:16.212021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:16.290029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:34:16.291250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:16.389732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 766/1494] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:34:16.397883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141827b1-25b8-44a3-9029-e51934f2222c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:16.398383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141827b1-25b8-44a3-9029-e51934f2222c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:16.398490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141827b1-25b8-44a3-9029-e51934f2222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:16.475164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-141827b1-25b8-44a3-9029-e51934f2222c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:34:16.476303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-141827b1-25b8-44a3-9029-e51934f2222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:16.572460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 729/1495] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:34:16.577156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:16.578357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:16.589704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e072b0-329b-4607-9a31-79176138ca91 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:16.651111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:16.684697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:16.685530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:16.686016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:16.686593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:16.687363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:34:16.687702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:16.688706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:16.688706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:34:16.688706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:34:16.689615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:16.701217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 767/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:34:16.709470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141827b1-25b8-44a3-9029-e51934f2222c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:16.719140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141827b1-25b8-44a3-9029-e51934f2222c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:16.779119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:16.813823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:16.814421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:16.814696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:16.814961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:16.815576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:16.817413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:16.817413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: warnings.warn(msg) Sep 09 21:34:16.817413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: Sep 09 21:34:16.818603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:16.941398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 730/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:34:16 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:34:16.946078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:16.947866 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:16.981063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd87b7-b5b9-4631-8235-696d8525a1c7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:17.075619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:17.076150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:17.076428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:17.076701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:17.077362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:17.078366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:17.078366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:34:17.078366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:34:17.079564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:17.227191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 768/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:34:16 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:34:17.232136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:17.233760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:17.295240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bfa4c-b6d6-4054-9fa7-aadc767ec4d7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:17.380453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:17.390205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:17.390807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:17.391077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:17.391343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:17.391971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:17.392977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:17.392977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: warnings.warn(msg) Sep 09 21:34:17.392977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: Sep 09 21:34:17.393876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:17.406956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 731/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:34:17.410979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:17.414001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:17.426265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff179-3a99-4b32-bca5-4c3f6c57ed5b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:17.453729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:17.531412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95cb95-a3d0-4cc6-a664-ef9c217b3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:17.532025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95cb95-a3d0-4cc6-a664-ef9c217b3ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:17.532301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95cb95-a3d0-4cc6-a664-ef9c217b3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:17.532565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95cb95-a3d0-4cc6-a664-ef9c217b3ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:17.533224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95cb95-a3d0-4cc6-a664-ef9c217b3ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:17.534286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-5b95cb95-a3d0-4cc6-a664-ef9c217b3ed2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:17.534286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:34:17.534286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:34:17.535155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95cb95-a3d0-4cc6-a664-ef9c217b3ed2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:17.548178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 769/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:34:17.552719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:17.554340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:17.588835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e973b9-963c-473f-a468-5ff1e621480d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:17.682247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971d0be-be29-4dd3-8f85-c7c055f799c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:17.682837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971d0be-be29-4dd3-8f85-c7c055f799c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:17.683116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971d0be-be29-4dd3-8f85-c7c055f799c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:17.683390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971d0be-be29-4dd3-8f85-c7c055f799c5 admin admin] PATH_INFO: `/v3/projects/f1736dac5e8d4f14804073e0cea05fd5/users/fa1b3da55009489baf1cd9628d3ef385/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:17.705477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971d0be-be29-4dd3-8f85-c7c055f799c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1736dac5e8d4f14804073e0cea05fd5, user_id=fa1b3da55009489baf1cd9628d3ef385, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:17.706512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-8971d0be-be29-4dd3-8f85-c7c055f799c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:17.706512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: warnings.warn(msg) Sep 09 21:34:17.706512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: Sep 09 21:34:17.708455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971d0be-be29-4dd3-8f85-c7c055f799c5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:17.785270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 732/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:34:17 2022] PUT /identity/v3/projects/f1736dac5e8d4f14804073e0cea05fd5/users/fa1b3da55009489baf1cd9628d3ef385/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:34:17.798066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6b85-ebdd-438a-940b-3a50591a5910 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:17.798414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6b85-ebdd-438a-940b-3a50591a5910 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:17.798629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6b85-ebdd-438a-940b-3a50591a5910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:17.859283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-366b6b85-ebdd-438a-940b-3a50591a5910 None None] MFA Rules not processed for user `fa1b3da55009489baf1cd9628d3ef385`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:34:17.860654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-366b6b85-ebdd-438a-940b-3a50591a5910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:17.923382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 770/1502] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:34:17.936761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2f93-cc17-4caa-9e52-dd4941808126 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:17.936990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2f93-cc17-4caa-9e52-dd4941808126 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:17.937301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2f93-cc17-4caa-9e52-dd4941808126 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:17.938678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 733/1503] 10.222.0.60 () {54 vars in 964 bytes} [Fri Sep 9 21:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:34:17.943403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36fb97-78a1-454e-885b-fd3b08f2107c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:17.943690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36fb97-78a1-454e-885b-fd3b08f2107c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:17.943961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36fb97-78a1-454e-885b-fd3b08f2107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:18.004320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:18.013610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3f36fb97-78a1-454e-885b-fd3b08f2107c None None] MFA Rules not processed for user `1852c201959444ca8066470206aa6167`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:34:18.014821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3f36fb97-78a1-454e-885b-fd3b08f2107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:18.090321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 771/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Fri Sep 9 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:34:18.098165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2f93-cc17-4caa-9e52-dd4941808126 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:18.110028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2f93-cc17-4caa-9e52-dd4941808126 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:18.113531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:18.114118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:18.114397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:18.114669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:18.123084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:18.124512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:18.133021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 734/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:34:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:34:18.179173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b860dac-c8ce-4518-955c-ca812943d557 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:18.179451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b860dac-c8ce-4518-955c-ca812943d557 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:18.179728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b860dac-c8ce-4518-955c-ca812943d557 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:18.180976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 772/1506] 10.222.0.60 () {52 vars in 830 bytes} [Fri Sep 9 21:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:34:18.184601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:18.186018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:18.214298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f3fca-95cd-442b-a4be-4076ab2f73bc service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:18.218837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:18.219456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:18.219736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:18.220010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] PATH_INFO: `/v3/users/fa1b3da55009489baf1cd9628d3ef385` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:18.221199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1b3da55009489baf1cd9628d3ef385)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:18.222205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:18.222205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: warnings.warn(msg) Sep 09 21:34:18.222205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: Sep 09 21:34:18.223411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:18.249236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:18.467366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1b3da55009489baf1cd9628d3ef385'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:18.467996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1b3da55009489baf1cd9628d3ef385'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:18.482259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1b3da55009489baf1cd9628d3ef385'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:18.504895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1b3da55009489baf1cd9628d3ef385'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:18.505694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1b3da55009489baf1cd9628d3ef385'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:18.562509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 735/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:34:18 2022] DELETE /identity/v3/users/fa1b3da55009489baf1cd9628d3ef385 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:34:18.567039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:18.567498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:18.567617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:18.596185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:34:18.597421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:18.655003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 773/1508] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:34:18.664480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:18.666374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:18.750612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7660e4-5742-4ae1-a672-e635fbe23636 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:18.750612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a05e-cb8d-4a21-b068-0de6360a536f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:18.750612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a05e-cb8d-4a21-b068-0de6360a536f service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:18.750612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a05e-cb8d-4a21-b068-0de6360a536f service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:18.751080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a05e-cb8d-4a21-b068-0de6360a536f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:18.757468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a05e-cb8d-4a21-b068-0de6360a536f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:18.758930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a05e-cb8d-4a21-b068-0de6360a536f service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:18.768302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 736/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:34:19.267142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:34:19.268631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:34:19.280499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40f1c1-903e-4f75-9f5e-03c17a8cc7e0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:34:19.285044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:34:19.289588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:34:19.289588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:34:19.289588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] PATH_INFO: `/v3/projects/f1736dac5e8d4f14804073e0cea05fd5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:34:19.289588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1736dac5e8d4f14804073e0cea05fd5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:34:19.289588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:34:19.289588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:34:19.289588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:34:19.290527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:34:19.442612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1736dac5e8d4f14804073e0cea05fd5', 'request_id': 'req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:19.448619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1736dac5e8d4f14804073e0cea05fd5', 'request_id': 'req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:19.462329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1736dac5e8d4f14804073e0cea05fd5', 'request_id': 'req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:19.590819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] The token cache is being invalidate because project f1736dac5e8d4f14804073e0cea05fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:34:19.591431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:19.591677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f9b6ba6c-3dc2-4ecf-b6d6-77076f2cc9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:34:19.593318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 774/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:34:19 2022] DELETE /identity/v3/projects/f1736dac5e8d4f14804073e0cea05fd5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:34:28.764231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=9,keystone:SELECT=55,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:29.587441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:51.090379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd58fb-2198-43dd-9344-357faa750462 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:51.091078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd58fb-2198-43dd-9344-357faa750462 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:51.091078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd58fb-2198-43dd-9344-357faa750462 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:51.092305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 737/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:35:51.097447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e5779-519b-4825-9ccc-6dbcf2256de8 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:51.097869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e5779-519b-4825-9ccc-6dbcf2256de8 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:51.098002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e5779-519b-4825-9ccc-6dbcf2256de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:51.137543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c08e5779-519b-4825-9ccc-6dbcf2256de8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:35:51.138836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c08e5779-519b-4825-9ccc-6dbcf2256de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:35:51.196899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 775/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:35:51.350091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd58fb-2198-43dd-9344-357faa750462 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:35:51.352716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dddd58fb-2198-43dd-9344-357faa750462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:35:51.453022 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd58fb-2198-43dd-9344-357faa750462 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:35:51.458356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cc8d9-0435-4fe5-84a7-1a8b4c83b7ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:35:51.458951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cc8d9-0435-4fe5-84a7-1a8b4c83b7ee service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:51.459225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cc8d9-0435-4fe5-84a7-1a8b4c83b7ee service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:51.459493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cc8d9-0435-4fe5-84a7-1a8b4c83b7ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:51.467496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cc8d9-0435-4fe5-84a7-1a8b4c83b7ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:35:51.469088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cc8d9-0435-4fe5-84a7-1a8b4c83b7ee service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:35:51.478632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 738/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:35:52.558028 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ab5a-235d-440a-8ed9-c6b6707c61e4 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:52.558590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ab5a-235d-440a-8ed9-c6b6707c61e4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:52.558590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ab5a-235d-440a-8ed9-c6b6707c61e4 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:52.559912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 776/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:35:52.565950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db8843-613f-49f1-82d6-9b030ff2e024 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:52.566388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db8843-613f-49f1-82d6-9b030ff2e024 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:52.566535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db8843-613f-49f1-82d6-9b030ff2e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:52.587003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-10db8843-613f-49f1-82d6-9b030ff2e024 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:35:52.588188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-10db8843-613f-49f1-82d6-9b030ff2e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:35:52.595833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 739/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:35:52.746569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ab5a-235d-440a-8ed9-c6b6707c61e4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:35:52.761217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ab5a-235d-440a-8ed9-c6b6707c61e4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:35:52.766703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258427aa-1a18-4cd4-93fd-668c98e63f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:35:52.767428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258427aa-1a18-4cd4-93fd-668c98e63f45 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:52.767713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258427aa-1a18-4cd4-93fd-668c98e63f45 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:52.767982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258427aa-1a18-4cd4-93fd-668c98e63f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:52.776200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258427aa-1a18-4cd4-93fd-668c98e63f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:35:52.778036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258427aa-1a18-4cd4-93fd-668c98e63f45 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:35:52.787323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 777/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:35:53.219767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fd73-7811-4e09-be4e-686a06163adf None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:53.220057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fd73-7811-4e09-be4e-686a06163adf None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:53.220337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fd73-7811-4e09-be4e-686a06163adf None None] PATH_INFO: `/v3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:53.221681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 740/1517] 10.222.0.50 () {54 vars in 925 bytes} [Fri Sep 9 21:35:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:35:53.228141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0777b-5144-4225-8b10-a811ea1c732f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:53.228429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0777b-5144-4225-8b10-a811ea1c732f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:53.228727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0777b-5144-4225-8b10-a811ea1c732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:53.277789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b5b0777b-5144-4225-8b10-a811ea1c732f None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:35:53.278978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b5b0777b-5144-4225-8b10-a811ea1c732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:35:53.347851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 778/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Fri Sep 9 21:35:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:35:57.120651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16832e5-e98f-4708-bf58-898d559fc740 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:57.121097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16832e5-e98f-4708-bf58-898d559fc740 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:57.121241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16832e5-e98f-4708-bf58-898d559fc740 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:57.122520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 741/1519] 10.222.0.60 () {54 vars in 961 bytes} [Fri Sep 9 21:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:35:57.127411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213396e0-c68a-4246-99a4-69dc5ab8581a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:57.127832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213396e0-c68a-4246-99a4-69dc5ab8581a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:57.128002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213396e0-c68a-4246-99a4-69dc5ab8581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:57.148709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-213396e0-c68a-4246-99a4-69dc5ab8581a None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:35:57.151198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-213396e0-c68a-4246-99a4-69dc5ab8581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:35:57.158574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 779/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Sep 9 21:35:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:35:57.166373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16832e5-e98f-4708-bf58-898d559fc740 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:35:57.180574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16832e5-e98f-4708-bf58-898d559fc740 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:35:57.185532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe328e2-5f48-4664-88e1-a47c7e0a0d5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:35:57.186124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe328e2-5f48-4664-88e1-a47c7e0a0d5f service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:35:57.186411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe328e2-5f48-4664-88e1-a47c7e0a0d5f service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:35:57.186685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe328e2-5f48-4664-88e1-a47c7e0a0d5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:35:57.195719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe328e2-5f48-4664-88e1-a47c7e0a0d5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:35:57.197347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe328e2-5f48-4664-88e1-a47c7e0a0d5f service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:35:57.207131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 742/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:35:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:36:04.265636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c616-8db9-4db8-8727-470b407b9f4f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:04.266216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c616-8db9-4db8-8727-470b407b9f4f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:04.266216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c616-8db9-4db8-8727-470b407b9f4f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:04.267521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 780/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:36:04.273974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b743ce-aaaf-4558-8701-bde50d7534b2 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:04.274394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b743ce-aaaf-4558-8701-bde50d7534b2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:04.274519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b743ce-aaaf-4558-8701-bde50d7534b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:04.293489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-95b743ce-aaaf-4558-8701-bde50d7534b2 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:36:04.294658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-95b743ce-aaaf-4558-8701-bde50d7534b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:04.303401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 743/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:36:04.457331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2c616-8db9-4db8-8727-470b407b9f4f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:36:04.471179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2c616-8db9-4db8-8727-470b407b9f4f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:36:04.477016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82501efc-ab1f-4347-ae9f-26e0a5d09954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:36:04.477628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82501efc-ab1f-4347-ae9f-26e0a5d09954 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:04.477908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82501efc-ab1f-4347-ae9f-26e0a5d09954 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:04.478180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82501efc-ab1f-4347-ae9f-26e0a5d09954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:04.486036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82501efc-ab1f-4347-ae9f-26e0a5d09954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:36:04.487617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82501efc-ab1f-4347-ae9f-26e0a5d09954 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:36:04.497836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 781/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:36:05.598347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b2ed5-36cc-45b3-915c-5a3b9b2d6655 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:05.598943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b2ed5-36cc-45b3-915c-5a3b9b2d6655 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:05.598943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b2ed5-36cc-45b3-915c-5a3b9b2d6655 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:05.600178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 744/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 21:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:36:05.606217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d286f-202c-40d7-82a8-473497af07b5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:05.606667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d286f-202c-40d7-82a8-473497af07b5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:05.606766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d286f-202c-40d7-82a8-473497af07b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:05.626670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-750d286f-202c-40d7-82a8-473497af07b5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:36:05.627855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-750d286f-202c-40d7-82a8-473497af07b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:05.636367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 782/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 21:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:36:05.786825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b2ed5-36cc-45b3-915c-5a3b9b2d6655 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:36:05.802184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b2ed5-36cc-45b3-915c-5a3b9b2d6655 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:36:05.807660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7985a-707b-4534-8d42-193d0d82a73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:36:05.808258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7985a-707b-4534-8d42-193d0d82a73c service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:05.808537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7985a-707b-4534-8d42-193d0d82a73c service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:05.808805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7985a-707b-4534-8d42-193d0d82a73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:05.817436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7985a-707b-4534-8d42-193d0d82a73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:36:05.818991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7985a-707b-4534-8d42-193d0d82a73c service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:36:05.828052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 745/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:36:09.825656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8736-93a4-426c-b80c-062bfa46f141 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:09.826213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8736-93a4-426c-b80c-062bfa46f141 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:09.826213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8736-93a4-426c-b80c-062bfa46f141 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:09.827476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 783/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:36:09.833129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc610-3291-42e1-80d9-166a8737e089 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:09.833611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc610-3291-42e1-80d9-166a8737e089 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:09.833750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc610-3291-42e1-80d9-166a8737e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:09.854030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-331dc610-3291-42e1-80d9-166a8737e089 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:36:09.855221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-331dc610-3291-42e1-80d9-166a8737e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:09.863916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 746/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:36:10.149453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc8736-93a4-426c-b80c-062bfa46f141 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:36:10.151148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3ecc8736-93a4-426c-b80c-062bfa46f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:10.163179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:10.210083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc8736-93a4-426c-b80c-062bfa46f141 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:36:10.214059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb81e-6809-4684-8bed-2a9ebbfe9fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:36:10.214656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb81e-6809-4684-8bed-2a9ebbfe9fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:10.214928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb81e-6809-4684-8bed-2a9ebbfe9fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:10.215194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb81e-6809-4684-8bed-2a9ebbfe9fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:10.225834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb81e-6809-4684-8bed-2a9ebbfe9fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:36:10.227258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb81e-6809-4684-8bed-2a9ebbfe9fa4 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:36:10.236661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 784/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:36:12.387435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fd808-1e79-4a8b-a70f-6f18a466013a None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:12.388020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fd808-1e79-4a8b-a70f-6f18a466013a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:12.388020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fd808-1e79-4a8b-a70f-6f18a466013a None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:12.389393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 747/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:36:12.395140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf180d4-e93f-444d-a211-b477e3c29c99 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:12.395556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf180d4-e93f-444d-a211-b477e3c29c99 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:12.395682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf180d4-e93f-444d-a211-b477e3c29c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:12.415418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9cf180d4-e93f-444d-a211-b477e3c29c99 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:36:12.416607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9cf180d4-e93f-444d-a211-b477e3c29c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:12.424692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 785/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:36:12.711159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fd808-1e79-4a8b-a70f-6f18a466013a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:36:12.722009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fd808-1e79-4a8b-a70f-6f18a466013a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:36:12.725672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bec99-600a-4f45-8037-5adf285e74a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:36:12.726263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bec99-600a-4f45-8037-5adf285e74a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:12.726542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bec99-600a-4f45-8037-5adf285e74a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:12.726812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bec99-600a-4f45-8037-5adf285e74a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:12.735550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bec99-600a-4f45-8037-5adf285e74a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:36:12.736978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bec99-600a-4f45-8037-5adf285e74a2 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:36:12.746189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 748/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:36:16.366516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc3c45-3a48-49d9-8b42-fb1c7eac9f8c None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:16.367116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc3c45-3a48-49d9-8b42-fb1c7eac9f8c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:16.367116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc3c45-3a48-49d9-8b42-fb1c7eac9f8c None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:16.368504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 786/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:36:16.373842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11072c-6432-48e6-a5eb-3709a52dea60 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:16.374268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11072c-6432-48e6-a5eb-3709a52dea60 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:16.374417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11072c-6432-48e6-a5eb-3709a52dea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:16.396478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ff11072c-6432-48e6-a5eb-3709a52dea60 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:36:16.397706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ff11072c-6432-48e6-a5eb-3709a52dea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:16.405373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 749/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:36:16.714224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc3c45-3a48-49d9-8b42-fb1c7eac9f8c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:36:16.715901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a2fc3c45-3a48-49d9-8b42-fb1c7eac9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:16.772702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc3c45-3a48-49d9-8b42-fb1c7eac9f8c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:36:16.776161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0698e6-549a-4a9f-8318-3fd55aaa062d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:36:16.776760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0698e6-549a-4a9f-8318-3fd55aaa062d service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:16.777059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0698e6-549a-4a9f-8318-3fd55aaa062d service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:16.777336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0698e6-549a-4a9f-8318-3fd55aaa062d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:16.786445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0698e6-549a-4a9f-8318-3fd55aaa062d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:36:16.787864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0698e6-549a-4a9f-8318-3fd55aaa062d service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:36:16.797370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 787/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:36:19.031965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d65f-c8cf-44b8-b959-979ff329ee07 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:19.032428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d65f-c8cf-44b8-b959-979ff329ee07 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:19.032541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d65f-c8cf-44b8-b959-979ff329ee07 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:19.033878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 750/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 21:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:36:19.039712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e76fb-1588-4ea2-bdfe-ee14c90b9082 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:19.040146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e76fb-1588-4ea2-bdfe-ee14c90b9082 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:19.040255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e76fb-1588-4ea2-bdfe-ee14c90b9082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:19.059629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ea3e76fb-1588-4ea2-bdfe-ee14c90b9082 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:36:19.060754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ea3e76fb-1588-4ea2-bdfe-ee14c90b9082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:19.068739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 788/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 21:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:36:19.368939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90d65f-c8cf-44b8-b959-979ff329ee07 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:36:19.370616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5a90d65f-c8cf-44b8-b959-979ff329ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:36:19.378557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=77 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:19.384605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90d65f-c8cf-44b8-b959-979ff329ee07 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:36:19.388119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bfc57-ea67-4592-9ff1-6a3d8e83435d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:36:19.388720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bfc57-ea67-4592-9ff1-6a3d8e83435d service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:36:19.388998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bfc57-ea67-4592-9ff1-6a3d8e83435d service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:36:19.389313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bfc57-ea67-4592-9ff1-6a3d8e83435d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:36:19.398853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bfc57-ea67-4592-9ff1-6a3d8e83435d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:36:19.400286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bfc57-ea67-4592-9ff1-6a3d8e83435d service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:36:19.409656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 751/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:36:29.054854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=54 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:29.411773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:48.427119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095c92-4841-4bec-8f5c-ca46f9a29bc9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.427771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095c92-4841-4bec-8f5c-ca46f9a29bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.427771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095c92-4841-4bec-8f5c-ca46f9a29bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.447769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3af7b-9a28-4b72-bb75-08ecada149a1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.448884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3af7b-9a28-4b72-bb75-08ecada149a1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.449481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3af7b-9a28-4b72-bb75-08ecada149a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.455503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f2095c92-4841-4bec-8f5c-ca46f9a29bc9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:48.457136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f2095c92-4841-4bec-8f5c-ca46f9a29bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:48.469930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 789/1540] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:48.487001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4ba3af7b-9a28-4b72-bb75-08ecada149a1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:48.488255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4ba3af7b-9a28-4b72-bb75-08ecada149a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:48.493999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137410ec-e5dc-4e64-801a-a009eb803e78 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.494659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137410ec-e5dc-4e64-801a-a009eb803e78 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.502535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137410ec-e5dc-4e64-801a-a009eb803e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.506342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 752/1541] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:48.515893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091110a-cdc3-411c-86a7-bbc0ead90d4f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.516712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091110a-cdc3-411c-86a7-bbc0ead90d4f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.517697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091110a-cdc3-411c-86a7-bbc0ead90d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.534261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-137410ec-e5dc-4e64-801a-a009eb803e78 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:48.537280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-137410ec-e5dc-4e64-801a-a009eb803e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:48.550499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 790/1542] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:37:48.552050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b9b0-71a3-4043-9507-a8fe6a43970a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.552608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b9b0-71a3-4043-9507-a8fe6a43970a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.553118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b9b0-71a3-4043-9507-a8fe6a43970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.553260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3091110a-cdc3-411c-86a7-bbc0ead90d4f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:48.554574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3091110a-cdc3-411c-86a7-bbc0ead90d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:48.575489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 753/1543] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:48.576719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091110a-cdc3-411c-86a7-bbc0ead90d4f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:48.583677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7e32b9b0-71a3-4043-9507-a8fe6a43970a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:48.585000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7e32b9b0-71a3-4043-9507-a8fe6a43970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:48.595719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091110a-cdc3-411c-86a7-bbc0ead90d4f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:48.605403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 791/1544] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:48.606841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b9b0-71a3-4043-9507-a8fe6a43970a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:48.610979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:48.612104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.612577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.613059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.614240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:48.614626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:48.616037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:37:48.616037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: warnings.warn(msg) Sep 09 21:37:48.616037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: Sep 09 21:37:48.616957 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a751e2-b625-4c86-9689-0df897aee375 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:48.628703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b9b0-71a3-4043-9507-a8fe6a43970a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:48.639592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:48.641122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.641723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.642367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.643402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:48.643930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:48.645802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:48.648559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 754/1545] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:48.650436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1816-8e2a-4bed-8c5f-dad5872a06ae None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.650882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1816-8e2a-4bed-8c5f-dad5872a06ae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.651304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1816-8e2a-4bed-8c5f-dad5872a06ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.669250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 792/1546] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:48.670052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:48.687222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941e43a-5346-4792-906d-3949b6b52d31 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:48.691608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d96f1816-8e2a-4bed-8c5f-dad5872a06ae None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:48.692824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d96f1816-8e2a-4bed-8c5f-dad5872a06ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:48.708754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:48.709423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.709706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.709978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.710630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:48.711668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:37:48.711668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:37:48.711668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:37:48.712900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:48.714966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 755/1547] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:48.716035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f1816-8e2a-4bed-8c5f-dad5872a06ae None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:48.732272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f1816-8e2a-4bed-8c5f-dad5872a06ae None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:48.744558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c669-2020-45ba-81a6-a290898aad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:48.745225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c669-2020-45ba-81a6-a290898aad17 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.745577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c669-2020-45ba-81a6-a290898aad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.746379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c669-2020-45ba-81a6-a290898aad17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.747033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c669-2020-45ba-81a6-a290898aad17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:48.748991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c669-2020-45ba-81a6-a290898aad17 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:48.879209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 793/1548] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:48.880567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:48.910707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 756/1549] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:48.911998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b40c74-fecb-4ff2-ade0-8dc1cd906581 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:48.912292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b40c74-fecb-4ff2-ade0-8dc1cd906581 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:48.912554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b40c74-fecb-4ff2-ade0-8dc1cd906581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:48.957204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-68b40c74-fecb-4ff2-ade0-8dc1cd906581 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:48.958410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-68b40c74-fecb-4ff2-ade0-8dc1cd906581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:48.975807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201dda-3f2a-4100-92ff-e50f6d1fe64c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.023780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 757/1550] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.025158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f223-9175-401d-a612-774ca6f4a391 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.025486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f223-9175-401d-a612-774ca6f4a391 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.025766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f223-9175-401d-a612-774ca6f4a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.043158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.043790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.044071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.044345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.044995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:49.045335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.047114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.048355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6817f223-9175-401d-a612-774ca6f4a391 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.049778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6817f223-9175-401d-a612-774ca6f4a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.058719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 758/1551] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.059754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f223-9175-401d-a612-774ca6f4a391 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.062707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 794/1552] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:49.063694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.074735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198833-7d11-4f28-87f4-fd9b8389b7da admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.075030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f223-9175-401d-a612-774ca6f4a391 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.079431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbb0b-b5b8-44d2-a297-f20476be4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.079815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2923a7b-0198-4a4d-8f5f-600b78294781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.080027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbb0b-b5b8-44d2-a297-f20476be4112 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.080306 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbb0b-b5b8-44d2-a297-f20476be4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.080426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923a7b-0198-4a4d-8f5f-600b78294781 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.080583 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbb0b-b5b8-44d2-a297-f20476be4112 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.080704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923a7b-0198-4a4d-8f5f-600b78294781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.080936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923a7b-0198-4a4d-8f5f-600b78294781 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.081245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbb0b-b5b8-44d2-a297-f20476be4112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.081590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2923a7b-0198-4a4d-8f5f-600b78294781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.082591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-c2923a7b-0198-4a4d-8f5f-600b78294781 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:37:49.082591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: warnings.warn(msg) Sep 09 21:37:49.082591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: Sep 09 21:37:49.083151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbb0b-b5b8-44d2-a297-f20476be4112 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.083797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2923a7b-0198-4a4d-8f5f-600b78294781 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.179251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 795/1553] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:49.180617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d523ec1-2696-4749-a7f8-bc42a4eaf5da None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.180909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d523ec1-2696-4749-a7f8-bc42a4eaf5da None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.181212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d523ec1-2696-4749-a7f8-bc42a4eaf5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.205737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3d523ec1-2696-4749-a7f8-bc42a4eaf5da None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.205940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 759/1554] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:49.206060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d523ec1-2696-4749-a7f8-bc42a4eaf5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.206159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346847-6600-483b-a6eb-046309bf5f53 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.206453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346847-6600-483b-a6eb-046309bf5f53 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.206738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346847-6600-483b-a6eb-046309bf5f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.215313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 796/1555] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.216700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4467d-5e4f-4b1b-978d-d701ebff965b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.217180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4467d-5e4f-4b1b-978d-d701ebff965b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.217464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4467d-5e4f-4b1b-978d-d701ebff965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.231384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-45346847-6600-483b-a6eb-046309bf5f53 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.234571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-45346847-6600-483b-a6eb-046309bf5f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.238089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-83a4467d-5e4f-4b1b-978d-d701ebff965b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.239240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-83a4467d-5e4f-4b1b-978d-d701ebff965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.241439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 760/1556] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.242615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5666d3-e439-451a-96cb-aafcb70ac4c8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.242924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5666d3-e439-451a-96cb-aafcb70ac4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.243173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5666d3-e439-451a-96cb-aafcb70ac4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.255107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 797/1557] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.256475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a8f8-658a-443c-9164-fe813e2e2a25 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.256753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a8f8-658a-443c-9164-fe813e2e2a25 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.257017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a8f8-658a-443c-9164-fe813e2e2a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.264330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5f5666d3-e439-451a-96cb-aafcb70ac4c8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.265487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5f5666d3-e439-451a-96cb-aafcb70ac4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.273816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:49.274491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 761/1558] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.275111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5666d3-e439-451a-96cb-aafcb70ac4c8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.283490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7105a8f8-658a-443c-9164-fe813e2e2a25 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.292104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7105a8f8-658a-443c-9164-fe813e2e2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.292240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5666d3-e439-451a-96cb-aafcb70ac4c8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.292850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271bee9-03de-4d9b-8943-5972337a40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.293186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 798/1559] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.296946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271bee9-03de-4d9b-8943-5972337a40b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.296946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271bee9-03de-4d9b-8943-5972337a40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.296946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271bee9-03de-4d9b-8943-5972337a40b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.297232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105a8f8-658a-443c-9164-fe813e2e2a25 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.297337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271bee9-03de-4d9b-8943-5972337a40b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.297337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271bee9-03de-4d9b-8943-5972337a40b7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.303587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105a8f8-658a-443c-9164-fe813e2e2a25 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.308404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.309005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.309312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.309591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.310229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.311793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.322265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 799/1560] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:49.323049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.333182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646eacb-d3ed-4d2d-997c-c4c28e651de1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.337652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc216b-20b2-405e-b3e8-51859eed8ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.338210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc216b-20b2-405e-b3e8-51859eed8ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.338479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc216b-20b2-405e-b3e8-51859eed8ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.338749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc216b-20b2-405e-b3e8-51859eed8ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.339358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc216b-20b2-405e-b3e8-51859eed8ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.340891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc216b-20b2-405e-b3e8-51859eed8ab7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.351064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 800/1561] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:49.356798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b141-95b6-41e6-868d-54cd9de5d5d1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.356798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b141-95b6-41e6-868d-54cd9de5d5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.356798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b141-95b6-41e6-868d-54cd9de5d5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.371213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5c13b141-95b6-41e6-868d-54cd9de5d5d1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.372382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5c13b141-95b6-41e6-868d-54cd9de5d5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.380634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 801/1562] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.384368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3cc47-49e6-47a5-986f-0a3872093fae None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.384368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3cc47-49e6-47a5-986f-0a3872093fae None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.384368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3cc47-49e6-47a5-986f-0a3872093fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.394476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 762/1563] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:49.394476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae61f9-2b5c-489f-a1b9-9432af0bbb1d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.394476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae61f9-2b5c-489f-a1b9-9432af0bbb1d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.394476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae61f9-2b5c-489f-a1b9-9432af0bbb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.404284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-11a3cc47-49e6-47a5-986f-0a3872093fae None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.405611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-11a3cc47-49e6-47a5-986f-0a3872093fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.415262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d6ae61f9-2b5c-489f-a1b9-9432af0bbb1d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:49.416441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d6ae61f9-2b5c-489f-a1b9-9432af0bbb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:49.461306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:49.468737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 802/1564] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.472573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3cc47-49e6-47a5-986f-0a3872093fae None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.480515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 763/1565] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:49.480705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3cc47-49e6-47a5-986f-0a3872093fae None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.481937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae61f9-2b5c-489f-a1b9-9432af0bbb1d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.489172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.489815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.490093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.490393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.491008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:49.491313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.492297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae61f9-2b5c-489f-a1b9-9432af0bbb1d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.492903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.497167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.497770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.498049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.498320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.499024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:49.499328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.501678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.505695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 803/1566] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:49.520779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.520945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 764/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:49.520945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.522927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2d7f-3d6a-40ab-aab5-d0cf0c719605 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.525997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9281965-3838-4fa1-8c7d-586022a53ba9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.527965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.528582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.528862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.529179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.529826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.531408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.533970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.534577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.534859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.535129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.535766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.537455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.543886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 804/1568] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:49.544715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.551905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 765/1569] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:49.552705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.554763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38f0bd-d5a7-46a2-8977-f416980227b2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.560096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.560419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.560703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.560986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.561692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:49.562035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.564082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.564900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11e63-cca2-44de-aa9f-756f3d46c3fb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.569478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.570092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.570421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.570692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.571311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.573238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.583819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 805/1570] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:49.583819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.588048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a68c-077b-40d2-8dc0-22b2c047bfd5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.592638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.593243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.593525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.593799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.594458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:49.595901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.597519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.609377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 806/1571] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:49.610260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.620825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972739ce-5d18-4a02-93f9-2d584065be3a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.625453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.626543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.626820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.627093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.627719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:37:49.628021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.629603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.640770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 807/1572] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:37:49.642291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.651418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0853-8949-4a62-a519-90561e22c1ee admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.656094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.656661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.656950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.657378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.657990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.659839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.661916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 766/1573] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:49.661916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.671832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8547-2203-4c19-a0a2-c282de684a36 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.676653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.677312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.677588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.677858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.678526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.680551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.753522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 808/1574] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:49.754476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.780120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 767/1575] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:49.782591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.806601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:49.821332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c862c-2f4e-414a-a6a2-15d264634492 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.845163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff63f-58f3-4393-9be9-93c2e0e866d2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:49.850333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.851005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.851295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.851574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] PATH_INFO: `/v3/projects/d6db64145cd44492b0b8b4bf199c80e2/users/7d499eacd473452bba71deea8ac4c60e/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.866586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6db64145cd44492b0b8b4bf199c80e2, user_id=7d499eacd473452bba71deea8ac4c60e, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.869273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.880051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:49.881115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:49.881115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:49.881395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] PATH_INFO: `/v3/projects/d5f72bda03e74c2286ccaadba5fff35d/users/419c0e2718cd4140b07cf0c92a18c296/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:49.895762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f72bda03e74c2286ccaadba5fff35d, user_id=419c0e2718cd4140b07cf0c92a18c296, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:49.896777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:37:49.896777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:37:49.896777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:37:49.898752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:49.939162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 768/1576] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:49 2022] PUT /identity/v3/projects/d6db64145cd44492b0b8b4bf199c80e2/users/7d499eacd473452bba71deea8ac4c60e/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:49.940030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:49.997235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 809/1577] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:49 2022] PUT /identity/v3/projects/d5f72bda03e74c2286ccaadba5fff35d/users/419c0e2718cd4140b07cf0c92a18c296/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:49.998051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.006225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b343a-097b-4be5-bdce-9b708050047d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.015205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:50.061696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74926f-6fad-426b-b160-8945105529a8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.062562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.063815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.064633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.064633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.065133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.070444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.070564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.070564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.070564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.070564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.070993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.070993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.169278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 769/1578] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.170082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.198608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 810/1579] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:49 2022] POST /identity/v3/projects => generated 393 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.199518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.239206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75180c0-9c0e-4c63-97be-95d0ccc55f55 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.264552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df887-fce8-43fc-a9d9-697fe11a63b7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.269598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.270210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.270488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.270764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.271404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.272974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.275443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:50.284299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 811/1580] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:50.292537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.295570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62564665-4dda-400a-88c8-61ee15e48d2b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.297177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d5dfb-d5c3-44ef-b0ad-deeb491110d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.298631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d5dfb-d5c3-44ef-b0ad-deeb491110d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.298910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d5dfb-d5c3-44ef-b0ad-deeb491110d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.299178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d5dfb-d5c3-44ef-b0ad-deeb491110d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.299801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d5dfb-d5c3-44ef-b0ad-deeb491110d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.300879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.301490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.301742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d5dfb-d5c3-44ef-b0ad-deeb491110d1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.301851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.302018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.302635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.304571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.436859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 812/1581] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.437700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.447172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf66143-a296-4797-ae05-cbbe4de58b9c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.451602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529993f-ca96-4334-9e43-7abdd4f52a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.452166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529993f-ca96-4334-9e43-7abdd4f52a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.452439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529993f-ca96-4334-9e43-7abdd4f52a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.452708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529993f-ca96-4334-9e43-7abdd4f52a53 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.453341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529993f-ca96-4334-9e43-7abdd4f52a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.455280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529993f-ca96-4334-9e43-7abdd4f52a53 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.488011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 770/1582] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.488011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86955f9-7296-449b-bfc6-704cbf0c65ae None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.488011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86955f9-7296-449b-bfc6-704cbf0c65ae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.488011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86955f9-7296-449b-bfc6-704cbf0c65ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.513682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f86955f9-7296-449b-bfc6-704cbf0c65ae None None] MFA Rules not processed for user `7d499eacd473452bba71deea8ac4c60e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:50.516038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f86955f9-7296-449b-bfc6-704cbf0c65ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:50.533277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:50.545833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 813/1583] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.547079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2412a6-ee9b-48d6-926f-87390bb207f4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.547366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2412a6-ee9b-48d6-926f-87390bb207f4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.548365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2412a6-ee9b-48d6-926f-87390bb207f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.567021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3d2412a6-ee9b-48d6-926f-87390bb207f4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:50.573580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d2412a6-ee9b-48d6-926f-87390bb207f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:50.582892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 771/1584] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:50.583712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86955f9-7296-449b-bfc6-704cbf0c65ae None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.628825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 814/1585] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:50.630012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2412a6-ee9b-48d6-926f-87390bb207f4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.639397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2412a6-ee9b-48d6-926f-87390bb207f4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.644728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.645356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.645640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.645913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.646571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.648468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.649921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86955f9-7296-449b-bfc6-704cbf0c65ae None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.654364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.654967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.655248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.655521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.656149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.658608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.717194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 815/1586] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.718024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.728470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20e6d7-9189-4794-8b70-b952ca50762e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.733013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.733626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.733929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.734202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.738716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 772/1587] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.738882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.738999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.739092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.748092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a768af-2556-456c-8274-d4b8e8522c12 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.752476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 816/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:50.752476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.753910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.754515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.754794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.755076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.755811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.757557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.759924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b31c-8142-409b-a4f8-deb90af297e9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.764458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.765052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.765344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.765616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.766796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.771739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 773/1589] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:50.771885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.771986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.780864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e64ef-f788-49c8-9973-e20cb59d5c11 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.786260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.787211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.787492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.787762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.788396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.790319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.802397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 774/1590] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:50.803305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.812660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19304a-67cc-4764-bedf-b732adcb4d9b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.818028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.818621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.818902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.819174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.819805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.821703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.832384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 817/1591] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/users => generated 289 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.833504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.890392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 775/1592] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:50 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:50.892012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.896358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103088-4535-4df8-b7d8-0518a5daa5f8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.926208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:50.945100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.945799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.946036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.946267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.955718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e585-d995-48bd-9bcd-df14dc04b3d2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.955882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.957354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.960473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.961105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.961383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.961652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.962294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.963887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.966985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 818/1593] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:50.968023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.978075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 776/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:50.978075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:50.979204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ccfc0-3022-4a24-a1ca-7767059405a7 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.982151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:50.983898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.984499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.984779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.985301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:50.985951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:50.987536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:50.988050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112169-67cd-45f2-9828-07d2ba709187 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:50.993392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:50.994729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:50.994729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:50.994729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] PATH_INFO: `/v3/projects/5977e34b3819428487be28be492a9cc5/users/30517a4b639c4a76a8f194f910c19720/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.000954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 819/1595] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.000954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.008509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0552fb-76ca-44e3-a4e6-99fd359a0d84 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.013587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.014435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.014435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.014711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.014918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5977e34b3819428487be28be492a9cc5, user_id=30517a4b639c4a76a8f194f910c19720, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.015348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.017603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.018364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.028015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 820/1596] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.028802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.039727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098efc70-365e-4cfe-a7d4-da7fd17a2b96 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.044329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.044911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.045223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.045496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.046126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.047937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.059149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 821/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.059926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.070481 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354c457-b6b5-4e95-a1f4-ff7d7747b2b1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.075142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.075729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.075996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.078367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.078367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.078553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.088937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 822/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.089710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.099804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e2ea5-6c21-491c-9ced-681e1757bc82 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.105835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.109612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.109612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.109612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.109612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.109612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.112000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 777/1599] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:50 2022] PUT /identity/v3/projects/5977e34b3819428487be28be492a9cc5/users/30517a4b639c4a76a8f194f910c19720/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:51.112818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.182702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82005-6dff-44dd-9102-d677b24b9012 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.187536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.188721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.189429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.189547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.190108 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.191742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.201926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 778/1600] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.202756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.215053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 823/1601] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:51 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:51.218737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedcc05-af01-4bb1-b218-0fc75e02bce7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.218854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.221719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.222351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.222634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.222906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.223543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.224545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653680c8-4a8e-4397-83ff-021d4468b85c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.225213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.229860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.230511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.230793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.231069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] PATH_INFO: `/v3/projects/f7804157dc6e4bc0929eadb7d1632f73/users/47091634f81746e7b68d3e78746e2f53/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.236764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 779/1602] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.237696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.248282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7804157dc6e4bc0929eadb7d1632f73, user_id=47091634f81746e7b68d3e78746e2f53, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.248476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5289e-4d9c-4346-938f-7f2600ca6494 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.252325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.253718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfaac1-2e0a-4d09-a076-f05d49cf6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.254367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfaac1-2e0a-4d09-a076-f05d49cf6370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.254645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfaac1-2e0a-4d09-a076-f05d49cf6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.254919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfaac1-2e0a-4d09-a076-f05d49cf6370 admin admin] PATH_INFO: `/v3/projects/3612671e4c9d40b3962863443febdf54/users/e844d113e8f84c6a9ddae8eb492781e7/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.271104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfaac1-2e0a-4d09-a076-f05d49cf6370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3612671e4c9d40b3962863443febdf54, user_id=e844d113e8f84c6a9ddae8eb492781e7, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.272832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfaac1-2e0a-4d09-a076-f05d49cf6370 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.324417 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 824/1603] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:51 2022] PUT /identity/v3/projects/f7804157dc6e4bc0929eadb7d1632f73/users/47091634f81746e7b68d3e78746e2f53/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:51.329476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.395718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 780/1604] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:51 2022] PUT /identity/v3/projects/3612671e4c9d40b3962863443febdf54/users/e844d113e8f84c6a9ddae8eb492781e7/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:51.397230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b403-a6a0-4d7b-add1-b8bedbfdbb68 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.397517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b403-a6a0-4d7b-add1-b8bedbfdbb68 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.397791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b403-a6a0-4d7b-add1-b8bedbfdbb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.398405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bee79c-c99f-4139-938f-f72078a6bf3c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.419829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f0f2b403-a6a0-4d7b-add1-b8bedbfdbb68 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:51.421048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f0f2b403-a6a0-4d7b-add1-b8bedbfdbb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:51.456291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:51.462300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.462915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.463197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.463472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.464112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.465826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.475881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 825/1605] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.476667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.484192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 781/1606] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:51.486066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b403-a6a0-4d7b-add1-b8bedbfdbb68 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.488675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2cb0-20ae-4787-868d-ecf67245cbac admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.493408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162f8d-bc21-407c-bbc5-8f123bdd2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.494701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162f8d-bc21-407c-bbc5-8f123bdd2bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.494701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162f8d-bc21-407c-bbc5-8f123bdd2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.494701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162f8d-bc21-407c-bbc5-8f123bdd2bfc admin admin] PATH_INFO: `/v3/projects/991b8df75560400ab53df07d68c506a5/users/3ecfea42ece24ef095287d27dd752cb6/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.495814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b403-a6a0-4d7b-add1-b8bedbfdbb68 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.500371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.501588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.501868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.502136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.502777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.504485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.509686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162f8d-bc21-407c-bbc5-8f123bdd2bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=991b8df75560400ab53df07d68c506a5, user_id=3ecfea42ece24ef095287d27dd752cb6, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.512317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162f8d-bc21-407c-bbc5-8f123bdd2bfc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.514547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 782/1607] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:51.515321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.525097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21cdd-48ab-4f93-b1cd-0f66a6c6bfe4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.529680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf802-b8d2-4236-ae66-981ddd6d9eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.530301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf802-b8d2-4236-ae66-981ddd6d9eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.530582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf802-b8d2-4236-ae66-981ddd6d9eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.530856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf802-b8d2-4236-ae66-981ddd6d9eb8 admin admin] PATH_INFO: `/v3/projects/edea72eab98d454db0b97987e618d804/users/242b7addfe7747b585833e0475510038/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.545922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf802-b8d2-4236-ae66-981ddd6d9eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edea72eab98d454db0b97987e618d804, user_id=242b7addfe7747b585833e0475510038, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.549715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf802-b8d2-4236-ae66-981ddd6d9eb8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.632339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 826/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:51 2022] PUT /identity/v3/projects/991b8df75560400ab53df07d68c506a5/users/3ecfea42ece24ef095287d27dd752cb6/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:51.633702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49ba4b-8136-4223-9a85-387902e4e3e3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.633992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49ba4b-8136-4223-9a85-387902e4e3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.634289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49ba4b-8136-4223-9a85-387902e4e3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.655809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fc49ba4b-8136-4223-9a85-387902e4e3e3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:51.658075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fc49ba4b-8136-4223-9a85-387902e4e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:51.658203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 783/1609] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:51 2022] PUT /identity/v3/projects/edea72eab98d454db0b97987e618d804/users/242b7addfe7747b585833e0475510038/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:51.659024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17783e3f-d982-4e99-a76c-0cbeafd39200 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.659568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17783e3f-d982-4e99-a76c-0cbeafd39200 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.660031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17783e3f-d982-4e99-a76c-0cbeafd39200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.671674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:51.699983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-17783e3f-d982-4e99-a76c-0cbeafd39200 None None] MFA Rules not processed for user `e844d113e8f84c6a9ddae8eb492781e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:51.701255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-17783e3f-d982-4e99-a76c-0cbeafd39200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:51.745559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 827/1610] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:51.746172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49ba4b-8136-4223-9a85-387902e4e3e3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.757589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49ba4b-8136-4223-9a85-387902e4e3e3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.762259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.762797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.763072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.763339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] PATH_INFO: `/v3/projects/944ba387570b4a048b7603dda55cd9c5/users/c3713a10f2cb4a6c81a4ca06d6f9a60d/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.772934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 784/1611] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:51.773804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17783e3f-d982-4e99-a76c-0cbeafd39200 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.779365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944ba387570b4a048b7603dda55cd9c5, user_id=c3713a10f2cb4a6c81a4ca06d6f9a60d, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.782169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.833457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17783e3f-d982-4e99-a76c-0cbeafd39200 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.837135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3512-1f0f-4cb3-b5da-46d6e9538561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.837746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3512-1f0f-4cb3-b5da-46d6e9538561 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.838028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3512-1f0f-4cb3-b5da-46d6e9538561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.838299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3512-1f0f-4cb3-b5da-46d6e9538561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.848419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3512-1f0f-4cb3-b5da-46d6e9538561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.850041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3512-1f0f-4cb3-b5da-46d6e9538561 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.851755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 828/1612] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:51 2022] PUT /identity/v3/projects/944ba387570b4a048b7603dda55cd9c5/users/c3713a10f2cb4a6c81a4ca06d6f9a60d/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:51.852859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:51.861727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 785/1613] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:51.863576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf210bd-fca5-48b5-8d85-be93d7f57762 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.863576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf210bd-fca5-48b5-8d85-be93d7f57762 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.863783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf210bd-fca5-48b5-8d85-be93d7f57762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.885164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-cdf210bd-fca5-48b5-8d85-be93d7f57762 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:51.886432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cdf210bd-fca5-48b5-8d85-be93d7f57762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:51.939408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e8871-8e50-475e-ab87-8b3d62e5b156 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:51.945057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:51.945737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.946027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.946288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] PATH_INFO: `/v3/projects/4061a428df124a4094bdad4a48174c86/users/996c87aaf5a94bf992a3985f57eeca4c/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.965062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 786/1614] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:51.967090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:51.967253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:51.967616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:51.983791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4061a428df124a4094bdad4a48174c86, user_id=996c87aaf5a94bf992a3985f57eeca4c, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:51.987876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:51.999746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] MFA Rules not processed for user `242b7addfe7747b585833e0475510038`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:52.001067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:52.028498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:52.077647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 787/1616] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:52.077647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.077647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:52.084394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 829/1616] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:51 2022] PUT /identity/v3/projects/4061a428df124a4094bdad4a48174c86/users/996c87aaf5a94bf992a3985f57eeca4c/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:52.085686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.137588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:52.144147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330099-d90b-4b8a-9cd3-60a90232ecf6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.177274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e301671-87cf-475e-9e7b-9e8abcbcea2e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.182896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7d83-465f-49bb-8812-9d74a3a1b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.184090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7d83-465f-49bb-8812-9d74a3a1b5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.184231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7d83-465f-49bb-8812-9d74a3a1b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.184511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7d83-465f-49bb-8812-9d74a3a1b5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.185283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b7d83-465f-49bb-8812-9d74a3a1b5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.189175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b7d83-465f-49bb-8812-9d74a3a1b5bc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.207680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf8f07-dee6-4085-acc1-cda17ac923d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.208481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf8f07-dee6-4085-acc1-cda17ac923d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.208768 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf8f07-dee6-4085-acc1-cda17ac923d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.209143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf8f07-dee6-4085-acc1-cda17ac923d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.219053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf8f07-dee6-4085-acc1-cda17ac923d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.220867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf8f07-dee6-4085-acc1-cda17ac923d8 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.231038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 788/1617] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:52.232330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6b92-9f4f-4819-9368-0b491bf8e1b5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.235679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6b92-9f4f-4819-9368-0b491bf8e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.235679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6b92-9f4f-4819-9368-0b491bf8e1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.254084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-012a6b92-9f4f-4819-9368-0b491bf8e1b5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:52.255297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-012a6b92-9f4f-4819-9368-0b491bf8e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:52.262994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 789/1618] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:52.263843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6b92-9f4f-4819-9368-0b491bf8e1b5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.277121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6b92-9f4f-4819-9368-0b491bf8e1b5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.282459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.282459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.282459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.282459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.292334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.293904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.304815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 790/1619] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:52.305781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.314733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 830/1620] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:37:52 2022] POST /identity/v3/projects => generated 381 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:52.316071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9478e-ffef-4bde-98ec-2a8e4e936e13 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.316316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc71e06-a1c8-4ae2-bdcb-4768b7bc40ce None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.316670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc71e06-a1c8-4ae2-bdcb-4768b7bc40ce None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.317013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc71e06-a1c8-4ae2-bdcb-4768b7bc40ce None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.318918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 831/1621] 10.222.0.60 () {54 vars in 962 bytes} [Fri Sep 9 21:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:37:52.319605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc71e06-a1c8-4ae2-bdcb-4768b7bc40ce None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.390259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.390888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.392462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.392462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.392727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.394484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.408178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 791/1622] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:52.409183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.415566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:52.418012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc71e06-a1c8-4ae2-bdcb-4768b7bc40ce None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.422122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63730-5418-480f-9cd5-1ad23ee269ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.423158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fdfc-4f52-4d69-980e-2fef8bd79d8d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.423292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63730-5418-480f-9cd5-1ad23ee269ee service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.423474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63730-5418-480f-9cd5-1ad23ee269ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.423763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63730-5418-480f-9cd5-1ad23ee269ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.429751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.430162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.430449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.430722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.431360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.433646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.434683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f63730-5418-480f-9cd5-1ad23ee269ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.436307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f63730-5418-480f-9cd5-1ad23ee269ee service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.449185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 832/1623] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:52.450850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462b1e-f756-4da8-9ab3-451dc22540d4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.451200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462b1e-f756-4da8-9ab3-451dc22540d4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.451472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462b1e-f756-4da8-9ab3-451dc22540d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.492938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-80462b1e-f756-4da8-9ab3-451dc22540d4 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:52.494667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-80462b1e-f756-4da8-9ab3-451dc22540d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:52.543092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 792/1624] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:37:52 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:37:52.543925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.557067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976789c-3aba-4ef1-a251-6221ca5ab551 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.562267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.563008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.564801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.564801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] PATH_INFO: `/v3/projects/4061a428df124a4094bdad4a48174c86/users/996c87aaf5a94bf992a3985f57eeca4c/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.573804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4061a428df124a4094bdad4a48174c86, user_id=996c87aaf5a94bf992a3985f57eeca4c, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.573804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.593246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 793/1625] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:52 2022] PUT /identity/v3/projects/4061a428df124a4094bdad4a48174c86/users/996c87aaf5a94bf992a3985f57eeca4c/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:52.594418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.617177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 833/1626] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Sep 9 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:52.621626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d077-c5fe-4f97-b30b-c76f0d0a575d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.621916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d077-c5fe-4f97-b30b-c76f0d0a575d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.622191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d077-c5fe-4f97-b30b-c76f0d0a575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.693073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a384d077-c5fe-4f97-b30b-c76f0d0a575d None None] MFA Rules not processed for user `996c87aaf5a94bf992a3985f57eeca4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:52.694289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a384d077-c5fe-4f97-b30b-c76f0d0a575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:52.697119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16580-bd98-4aff-b4c3-46994bd88f66 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.702605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.703227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.703507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.704769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.705332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.707132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:52.718945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 794/1627] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:52.719918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.747255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:52.872766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 834/1628] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:52.872766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384d077-c5fe-4f97-b30b-c76f0d0a575d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:52.891822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384d077-c5fe-4f97-b30b-c76f0d0a575d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.895595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245f9e-1e71-46b8-b357-6ad00365a09f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:52.904101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.904793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.905095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.905376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] PATH_INFO: `/v3/projects/c86081cf9c1b4802a34d4025956756f5/users/c4620d35b85842e1992dd611650ebe06/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.909135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:52.910399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:52.910693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:52.910970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:52.940447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86081cf9c1b4802a34d4025956756f5, user_id=c4620d35b85842e1992dd611650ebe06, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:52.948411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:53.003848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:53.005501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:53.019285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 795/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:53.020538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:53.027024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:53.081236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 835/1630] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:52 2022] PUT /identity/v3/projects/c86081cf9c1b4802a34d4025956756f5/users/c4620d35b85842e1992dd611650ebe06/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:53.082297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:53.140814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bfc9e-476c-4c3a-aa23-d2f8c393ffff service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:53.247160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a423f-9709-4488-a52b-2ff080ad322d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:53.258940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:53.259568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.259847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.260121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.262874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:53.265886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:53.293072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 836/1631] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:37:53.295912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065ff3-a2cb-41e5-b990-97e45c024125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:53.295912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065ff3-a2cb-41e5-b990-97e45c024125 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.295912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065ff3-a2cb-41e5-b990-97e45c024125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.295912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065ff3-a2cb-41e5-b990-97e45c024125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.296256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:53.317753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322c4e-1ec4-4f4e-b73c-bc6965414701 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:53.331102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3147-2e59-4a3c-87fa-ea8ca2bcc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:53.331878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3147-2e59-4a3c-87fa-ea8ca2bcc92b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.332152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3147-2e59-4a3c-87fa-ea8ca2bcc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.332421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3147-2e59-4a3c-87fa-ea8ca2bcc92b admin admin] PATH_INFO: `/v3/projects/c86081cf9c1b4802a34d4025956756f5/users/c4620d35b85842e1992dd611650ebe06/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.340113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b3147-2e59-4a3c-87fa-ea8ca2bcc92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86081cf9c1b4802a34d4025956756f5, user_id=c4620d35b85842e1992dd611650ebe06, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:53.348131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b3147-2e59-4a3c-87fa-ea8ca2bcc92b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:53.374910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 837/1632] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:37:53 2022] PUT /identity/v3/projects/c86081cf9c1b4802a34d4025956756f5/users/c4620d35b85842e1992dd611650ebe06/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:53.376905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea065ff3-a2cb-41e5-b990-97e45c024125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:53.377242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958951c-1ebc-4fdf-8ee0-88a13039e84f None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.387118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958951c-1ebc-4fdf-8ee0-88a13039e84f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.387118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958951c-1ebc-4fdf-8ee0-88a13039e84f None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.387863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea065ff3-a2cb-41e5-b990-97e45c024125 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:53.387962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 838/1633] 10.222.0.60 () {54 vars in 912 bytes} [Fri Sep 9 21:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:37:53.387962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011f615-696c-4675-bb2f-46c140585785 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.387962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011f615-696c-4675-bb2f-46c140585785 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.387962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011f615-696c-4675-bb2f-46c140585785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.407502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 796/1634] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:53.409119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9d13f-78bd-4a50-9790-9bc1046e25a8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.409404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9d13f-78bd-4a50-9790-9bc1046e25a8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.409562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5011f615-696c-4675-bb2f-46c140585785 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:53.409678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9d13f-78bd-4a50-9790-9bc1046e25a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.410855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5011f615-696c-4675-bb2f-46c140585785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:53.473568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4ac9d13f-78bd-4a50-9790-9bc1046e25a8 None None] MFA Rules not processed for user `c4620d35b85842e1992dd611650ebe06`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:53.476961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4ac9d13f-78bd-4a50-9790-9bc1046e25a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:53.497645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 839/1635] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:37:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:53.512135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011f615-696c-4675-bb2f-46c140585785 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:53.530754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:53.635500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011f615-696c-4675-bb2f-46c140585785 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:53.644772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:53.645690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.646181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.647019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.647351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 797/1636] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:53.677119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:53.677326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9d13f-78bd-4a50-9790-9bc1046e25a8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:53.678713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:53.690398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9d13f-78bd-4a50-9790-9bc1046e25a8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:53.695671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 840/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:53.720572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9620a-9b51-4ee9-9c21-5f7ab5ae2ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:53.722281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:53.722952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9620a-9b51-4ee9-9c21-5f7ab5ae2ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:53.723373 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9620a-9b51-4ee9-9c21-5f7ab5ae2ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:53.723724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9620a-9b51-4ee9-9c21-5f7ab5ae2ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:53.741705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9620a-9b51-4ee9-9c21-5f7ab5ae2ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:53.743429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9620a-9b51-4ee9-9c21-5f7ab5ae2ff1 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:53.757374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 798/1638] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:54.546014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:54.560873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0ea9-5777-41da-a14a-922b33a6e903 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:54.578016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6f612-550f-465c-9647-6ae73e36e832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:54.579166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6f612-550f-465c-9647-6ae73e36e832 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:54.579443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6f612-550f-465c-9647-6ae73e36e832 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:54.579710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6f612-550f-465c-9647-6ae73e36e832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:54.689158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6f612-550f-465c-9647-6ae73e36e832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:54.690852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6f612-550f-465c-9647-6ae73e36e832 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:54.722100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 841/1639] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:56.086462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac212b7b-066b-4f5b-a1a6-0690c337fbd8 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:56.087212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac212b7b-066b-4f5b-a1a6-0690c337fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:56.087317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac212b7b-066b-4f5b-a1a6-0690c337fbd8 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:56.089567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 799/1640] 10.222.0.60 () {54 vars in 962 bytes} [Fri Sep 9 21:37:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:37:56.106830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aebb7-3f3e-4914-815f-d2cbb79041d2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:56.107403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aebb7-3f3e-4914-815f-d2cbb79041d2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:56.107403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aebb7-3f3e-4914-815f-d2cbb79041d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:56.146486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5d1aebb7-3f3e-4914-815f-d2cbb79041d2 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:56.155284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d1aebb7-3f3e-4914-815f-d2cbb79041d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:56.173865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 842/1641] 10.222.0.60 () {58 vars in 1059 bytes} [Fri Sep 9 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:56.179426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd580-2943-4257-8f08-23d0769c778c None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:56.179711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd580-2943-4257-8f08-23d0769c778c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:56.179983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd580-2943-4257-8f08-23d0769c778c None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:56.181485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 800/1642] 10.222.0.60 () {54 vars in 912 bytes} [Fri Sep 9 21:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:37:56.186695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7238-82cc-4bae-9dc6-53537a3e81a4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:56.186973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7238-82cc-4bae-9dc6-53537a3e81a4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:56.187418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7238-82cc-4bae-9dc6-53537a3e81a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:56.230656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a79c7238-82cc-4bae-9dc6-53537a3e81a4 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:56.236316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a79c7238-82cc-4bae-9dc6-53537a3e81a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:56.259501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 843/1643] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:56.282844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bd580-2943-4257-8f08-23d0769c778c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:56.307230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bd580-2943-4257-8f08-23d0769c778c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:56.314172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875507c-6b1c-4d86-ab20-6741bece4e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:56.314862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875507c-6b1c-4d86-ab20-6741bece4e4f service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:56.315194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875507c-6b1c-4d86-ab20-6741bece4e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:56.315735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875507c-6b1c-4d86-ab20-6741bece4e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:56.345749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875507c-6b1c-4d86-ab20-6741bece4e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:56.347525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875507c-6b1c-4d86-ab20-6741bece4e4f service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:56.378934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 801/1644] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:56.389837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c7238-82cc-4bae-9dc6-53537a3e81a4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:56.583569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c7238-82cc-4bae-9dc6-53537a3e81a4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:56.600171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:56.601798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:56.602911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:56.603404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] PATH_INFO: `/v3/users/7d499eacd473452bba71deea8ac4c60e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:56.605654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d499eacd473452bba71deea8ac4c60e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:56.609478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: WARNING py.warnings [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:37:56.609478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: warnings.warn(msg) Sep 09 21:37:56.609478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: Sep 09 21:37:56.613293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:56.957358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:56.964449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d499eacd473452bba71deea8ac4c60e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:56.979316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d499eacd473452bba71deea8ac4c60e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:57.064886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d499eacd473452bba71deea8ac4c60e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:57.106376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d499eacd473452bba71deea8ac4c60e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:57.107050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d499eacd473452bba71deea8ac4c60e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:57.125607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 844/1645] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:37:56 2022] DELETE /identity/v3/users/7d499eacd473452bba71deea8ac4c60e => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:57.127975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:57.128926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:57.129419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:57.178288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:57.179553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:57.300083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 802/1646] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:37:57.319564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:57.324554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:57.456253 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e08ea-fd0e-410f-93d0-880c50af81d0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:57.460886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:57.461933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:57.462620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:57.463040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:57.494909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:57.502602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:57.519153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 845/1647] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:37:59.217874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:59.220089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:59.243061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f3122-78af-4341-b58b-ff1a30edbc21 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:59.260858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:59.267965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:59.267965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:59.267965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] PATH_INFO: `/v3/users/e844d113e8f84c6a9ddae8eb492781e7` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:59.267965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e844d113e8f84c6a9ddae8eb492781e7)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:59.269367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:59.602984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e844d113e8f84c6a9ddae8eb492781e7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.603536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:59.604015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e844d113e8f84c6a9ddae8eb492781e7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.605660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:59.631319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e844d113e8f84c6a9ddae8eb492781e7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.639075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7fd27-d693-4852-be39-baddeef0dc55 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:37:59.653281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e844d113e8f84c6a9ddae8eb492781e7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.653722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:37:59.654061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-44d1b221-7061-4efc-a026-5561041816fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e844d113e8f84c6a9ddae8eb492781e7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.655270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:59.657554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:59.658074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] PATH_INFO: `/v3/projects/d6db64145cd44492b0b8b4bf199c80e2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:59.661947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6db64145cd44492b0b8b4bf199c80e2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:37:59.665505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:37:59.770520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 803/1648] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:37:59 2022] DELETE /identity/v3/users/e844d113e8f84c6a9ddae8eb492781e7 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:37:59.777201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:37:59.777619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:37:59.777990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:37:59.809070 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:37:59.810505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:37:59.840864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6db64145cd44492b0b8b4bf199c80e2', 'request_id': 'req-2ee3a856-d857-4b22-9804-3622468471db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.882412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6db64145cd44492b0b8b4bf199c80e2', 'request_id': 'req-2ee3a856-d857-4b22-9804-3622468471db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.894115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6db64145cd44492b0b8b4bf199c80e2', 'request_id': 'req-2ee3a856-d857-4b22-9804-3622468471db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.946025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:59.985052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] The token cache is being invalidate because project d6db64145cd44492b0b8b4bf199c80e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:37:59.985336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.986879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:37:59.990661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 846/1649] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:37:59 2022] DELETE /identity/v3/projects/d6db64145cd44492b0b8b4bf199c80e2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:37:59.994094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:37:59.996351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:00.012561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 804/1650] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:00.032415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:00.034097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:00.118536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:00.170370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a856-d857-4b22-9804-3622468471db admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:00.188412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:00.189095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:00.194911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:00.194911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] PATH_INFO: `/v3/users/996c87aaf5a94bf992a3985f57eeca4c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:00.194911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996c87aaf5a94bf992a3985f57eeca4c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:00.194911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:00.238527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2575f72-d4ab-4d77-8fb8-cb5a3dae9e71 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:00.365319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:00.366168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:00.366641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:00.367082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:00.384951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:00.390538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:00.435656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 805/1651] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:00.475569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996c87aaf5a94bf992a3985f57eeca4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:00.497173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996c87aaf5a94bf992a3985f57eeca4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:00.616785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996c87aaf5a94bf992a3985f57eeca4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:00.638734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996c87aaf5a94bf992a3985f57eeca4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:00.639662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996c87aaf5a94bf992a3985f57eeca4c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:00.660006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 847/1652] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:37:59 2022] DELETE /identity/v3/users/996c87aaf5a94bf992a3985f57eeca4c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:02.759128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:02.777496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567311d-6c0e-4d8b-9f4d-ce9d78c8a639 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:02.782754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:02.784815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:03.026637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:03.027732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:03.028943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:03.035589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] PATH_INFO: `/v3/projects/4061a428df124a4094bdad4a48174c86` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:03.039608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4061a428df124a4094bdad4a48174c86)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:03.040920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: WARNING py.warnings [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 21:38:03.040920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: warnings.warn(msg) Sep 09 21:38:03.040920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: Sep 09 21:38:03.050480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:03.093982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca50c-b3d6-4694-aa06-13ff151ea226 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:03.106370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:03.107041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:03.107837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:03.108471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] PATH_INFO: `/v3/projects/3612671e4c9d40b3962863443febdf54` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:03.110797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3612671e4c9d40b3962863443febdf54)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:03.112887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:03.318793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:03.340104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4061a428df124a4094bdad4a48174c86', 'request_id': 'req-d23c8ef2-f559-45a5-9398-d57a5f2e8408'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.346837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3612671e4c9d40b3962863443febdf54', 'request_id': 'req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.366658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3612671e4c9d40b3962863443febdf54', 'request_id': 'req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.409766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3612671e4c9d40b3962863443febdf54', 'request_id': 'req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.419998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4061a428df124a4094bdad4a48174c86', 'request_id': 'req-d23c8ef2-f559-45a5-9398-d57a5f2e8408'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.441066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4061a428df124a4094bdad4a48174c86', 'request_id': 'req-d23c8ef2-f559-45a5-9398-d57a5f2e8408'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.443083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:03.473914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] The token cache is being invalidate because project 4061a428df124a4094bdad4a48174c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:03.474222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.475094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.489573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 806/1653] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:02 2022] DELETE /identity/v3/projects/4061a428df124a4094bdad4a48174c86 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:03.491482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:03.493326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:03.554920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] The token cache is being invalidate because project 3612671e4c9d40b3962863443febdf54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:03.555500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.556791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8f6da7e2-a90a-4dc1-bd96-dd9e9bd6bc31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.558936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 848/1654] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:02 2022] DELETE /identity/v3/projects/3612671e4c9d40b3962863443febdf54 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:03.564857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734128d1-3241-41d4-bb53-211198b80277 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:03.565168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734128d1-3241-41d4-bb53-211198b80277 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:03.568656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734128d1-3241-41d4-bb53-211198b80277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:03.602002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-734128d1-3241-41d4-bb53-211198b80277 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:03.603491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-734128d1-3241-41d4-bb53-211198b80277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:03.608104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8ef2-f559-45a5-9398-d57a5f2e8408 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:03.716736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:03.717420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:03.717699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:03.717970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] PATH_INFO: `/v3/users/242b7addfe7747b585833e0475510038` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:03.723017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=242b7addfe7747b585833e0475510038)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:03.724900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:03.789676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 849/1655] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:03.789676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734128d1-3241-41d4-bb53-211198b80277 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:03.789676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-734128d1-3241-41d4-bb53-211198b80277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:03.806480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734128d1-3241-41d4-bb53-211198b80277 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:03.814879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:03.815731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:03.816139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:03.816987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] PATH_INFO: `/v3/users/c4620d35b85842e1992dd611650ebe06` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:03.818553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4620d35b85842e1992dd611650ebe06)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:03.821456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:03.986991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242b7addfe7747b585833e0475510038'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:03.987690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242b7addfe7747b585833e0475510038'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.006663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242b7addfe7747b585833e0475510038'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.045093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242b7addfe7747b585833e0475510038'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.050979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b9efb034-3554-42de-b25a-e8c8548195ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242b7addfe7747b585833e0475510038'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.080002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4620d35b85842e1992dd611650ebe06'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.092955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4620d35b85842e1992dd611650ebe06'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.145424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:04.154335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 807/1656] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:03 2022] DELETE /identity/v3/users/242b7addfe7747b585833e0475510038 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:04.155524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f2c30-945d-4c1b-b4ce-bd6779f49d7f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:04.156595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f2c30-945d-4c1b-b4ce-bd6779f49d7f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:04.156875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f2c30-945d-4c1b-b4ce-bd6779f49d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:04.208718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-850f2c30-945d-4c1b-b4ce-bd6779f49d7f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:04.213061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-850f2c30-945d-4c1b-b4ce-bd6779f49d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:04.231042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4620d35b85842e1992dd611650ebe06'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.258756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4620d35b85842e1992dd611650ebe06'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.260585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-04cbf299-4879-472f-994f-fc0c3025c6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4620d35b85842e1992dd611650ebe06'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:04.287447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 850/1657] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:03 2022] DELETE /identity/v3/users/c4620d35b85842e1992dd611650ebe06 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:04.293011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb96ba-163c-4efc-88ea-23a35baf9245 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:04.293711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb96ba-163c-4efc-88ea-23a35baf9245 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:04.295130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb96ba-163c-4efc-88ea-23a35baf9245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:04.354222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a8bb96ba-163c-4efc-88ea-23a35baf9245 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:04.358200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a8bb96ba-163c-4efc-88ea-23a35baf9245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:04.419488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 808/1658] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:04.421500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60819-6e70-4fb2-b351-69c104b68c7b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:04.422239 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60819-6e70-4fb2-b351-69c104b68c7b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:04.422742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60819-6e70-4fb2-b351-69c104b68c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:04.479064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 851/1659] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:04.480065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb96ba-163c-4efc-88ea-23a35baf9245 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:04.490865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb96ba-163c-4efc-88ea-23a35baf9245 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:04.495555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-56b60819-6e70-4fb2-b351-69c104b68c7b None None] MFA Rules not processed for user `30517a4b639c4a76a8f194f910c19720`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:04.500162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-56b60819-6e70-4fb2-b351-69c104b68c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:04.506299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:04.508339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:04.510631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:04.510631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:04.510960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:04.513394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:04.515028 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:04.549532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 852/1660] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:04.550516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:04.552319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:04.612047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 809/1661] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:04.621126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60819-6e70-4fb2-b351-69c104b68c7b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:04.639107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60819-6e70-4fb2-b351-69c104b68c7b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:04.642619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499760f-0af0-4e48-a67a-e52e6a09ee53 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:04.644564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:04.645762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:04.645762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:04.645972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:04.646545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:04.648498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:04.650398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:04.654630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:04.657135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:04.657772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:04.658745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:04.677950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:04.679432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:04.691862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 853/1662] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:04.692997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:04.694454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:04.771311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 810/1663] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:04.776074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:04.860043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1101-eff9-40bd-9765-7b64954916d5 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:04.946363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771dadb-fe10-4a36-8931-0a243f2c8ee3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:04.953309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:04.954099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:04.954512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:04.954986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:04.955761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:04.958043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:05.021944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:05.022996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.023583 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.023888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:05.090475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 811/1664] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:04 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:38:05.094441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:05.107882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c61e-b8e0-4a15-89bf-8e47bf27e988 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:05.114150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:05.114816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.115113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.115407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:05.116111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:05.117982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:05.152714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 812/1665] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:05.159855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:05.190850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9600627-a1af-4f81-8f68-94030733ac07 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:05.199387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f40dc0-dca9-4aa8-b942-4c663639d3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:05.200765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f40dc0-dca9-4aa8-b942-4c663639d3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.201304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f40dc0-dca9-4aa8-b942-4c663639d3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.201783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f40dc0-dca9-4aa8-b942-4c663639d3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:05.202634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f40dc0-dca9-4aa8-b942-4c663639d3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:05.204784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f40dc0-dca9-4aa8-b942-4c663639d3e2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:05.209439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:05.211220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:05.222037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 854/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:05.222600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 813/1667] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:05.222930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:05.234906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6643c2-b9a2-4338-9048-584142c217b3 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:05.242286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:05.243333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.243653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.243962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] PATH_INFO: `/v3/projects/24703fa4e70b4c89a5badfccbfae9b9e/users/e895771e59284b29925b1a774e662c91/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:05.267374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24703fa4e70b4c89a5badfccbfae9b9e, user_id=e895771e59284b29925b1a774e662c91, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:05.270319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:05.349968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 855/1668] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:05 2022] PUT /identity/v3/projects/24703fa4e70b4c89a5badfccbfae9b9e/users/e895771e59284b29925b1a774e662c91/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:05.361449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29454-6501-49f1-a433-5c61e0ed3707 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.361847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29454-6501-49f1-a433-5c61e0ed3707 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.362249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29454-6501-49f1-a433-5c61e0ed3707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:05.394167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3bb29454-6501-49f1-a433-5c61e0ed3707 None None] MFA Rules not processed for user `e895771e59284b29925b1a774e662c91`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:05.395452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3bb29454-6501-49f1-a433-5c61e0ed3707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:05.427670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:05.429493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:05.449261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:05.563957 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 814/1669] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:05.569053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29454-6501-49f1-a433-5c61e0ed3707 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:05.589257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1245c-b8e3-4789-a0f6-ad6899eb5cd4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:05.592510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29454-6501-49f1-a433-5c61e0ed3707 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:05.602787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:05.605740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.606030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.606361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:05.607531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:05.609639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:05.612219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:05.613192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.613828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.614352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] PATH_INFO: `/v3/projects/edea72eab98d454db0b97987e618d804` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:05.623654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edea72eab98d454db0b97987e618d804)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:05.629225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:05.730815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 815/1670] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:05 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:05.735980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:05.816025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edea72eab98d454db0b97987e618d804', 'request_id': 'req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:05.852994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edea72eab98d454db0b97987e618d804', 'request_id': 'req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:05.885539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edea72eab98d454db0b97987e618d804', 'request_id': 'req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:05.957115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c79e-ba09-49d7-96cf-8be1f2445341 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:05.968169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] The token cache is being invalidate because project edea72eab98d454db0b97987e618d804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:05.969056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:05.970233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-cdd41a4a-0fef-466b-9bcc-a2cc23659ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:05.972975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 856/1671] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:05 2022] DELETE /identity/v3/projects/edea72eab98d454db0b97987e618d804 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:05.979267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42551-c187-46ad-a9bb-902f33bf6a86 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:05.980540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42551-c187-46ad-a9bb-902f33bf6a86 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:05.982164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42551-c187-46ad-a9bb-902f33bf6a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.036094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8ae42551-c187-46ad-a9bb-902f33bf6a86 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:06.040311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8ae42551-c187-46ad-a9bb-902f33bf6a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:06.121730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.125412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.126891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.127801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.130588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.135255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.153794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 857/1672] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:06.162548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bbe4a-38db-4e39-8423-9969ff671877 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.163110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bbe4a-38db-4e39-8423-9969ff671877 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.164462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bbe4a-38db-4e39-8423-9969ff671877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.209275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a42bbe4a-38db-4e39-8423-9969ff671877 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:06.211070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a42bbe4a-38db-4e39-8423-9969ff671877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:06.225804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 858/1673] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:06.236740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bbe4a-38db-4e39-8423-9969ff671877 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.249999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bbe4a-38db-4e39-8423-9969ff671877 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:06.258084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.259329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.259826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.260497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.263689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:06.264266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.266608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.284510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 816/1674] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:05 2022] POST /identity/v3/users => generated 300 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:06.287270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 859/1675] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:38:06.291963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.293859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.300779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:06.307342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:06.315825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ae89-f99f-4794-9c09-2184e1753aae admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:06.322884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597884de-5dea-4a17-9350-7d9b3ebfa765 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:06.324168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.324795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.325271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.325371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.326011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.328585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.335720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.336366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.336628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.336900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.337623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.339249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.364514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 817/1676] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:06.365482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.383081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152222ec-06d7-45ad-b61f-b69b9822f010 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:06.390120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.392292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.392847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.394053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] PATH_INFO: `/v3/projects/89de93d4746840a48a0387629257bee1/users/e07de8ce5e37434ea8faf021dcf5c49a/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.430424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:06.452361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89de93d4746840a48a0387629257bee1, user_id=e07de8ce5e37434ea8faf021dcf5c49a, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.460059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.474051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 860/1677] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:06 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:06.475717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.571279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 818/1678] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:06 2022] PUT /identity/v3/projects/89de93d4746840a48a0387629257bee1/users/e07de8ce5e37434ea8faf021dcf5c49a/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:06.574963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.616894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179dee2-b856-453d-a2bd-c3dd8cf62209 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:06.793771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.795373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.796847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.798647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.801067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.809792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.815276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc239be9-e01b-4e17-b012-b8b4931ee854 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:06.824482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.826394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.826987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.828434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.838985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.842094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:06.848646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.903216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 819/1679] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:06.903216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.922923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f294f0c-8679-4015-857c-dc6153e9b9e7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:06.936173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef37a-e552-471d-bc07-8c32d1d3b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:06.937331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef37a-e552-471d-bc07-8c32d1d3b01b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:06.939458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef37a-e552-471d-bc07-8c32d1d3b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:06.939842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef37a-e552-471d-bc07-8c32d1d3b01b admin admin] PATH_INFO: `/v3/projects/89de93d4746840a48a0387629257bee1/users/e07de8ce5e37434ea8faf021dcf5c49a/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:06.954717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef37a-e552-471d-bc07-8c32d1d3b01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89de93d4746840a48a0387629257bee1, user_id=e07de8ce5e37434ea8faf021dcf5c49a, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:06.954717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef37a-e552-471d-bc07-8c32d1d3b01b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:06.985875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 861/1680] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:06 2022] POST /identity/v3/users => generated 303 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:06.989796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:06.993155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 820/1681] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:06 2022] PUT /identity/v3/projects/89de93d4746840a48a0387629257bee1/users/e07de8ce5e37434ea8faf021dcf5c49a/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:07.003932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.004215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.006678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.014680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d2f81-e3fc-4df1-98e9-00e53ec5c939 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:07.049130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] MFA Rules not processed for user `e07de8ce5e37434ea8faf021dcf5c49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:07.050556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:07.188720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:07.189430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.189713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.190000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.194225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:07.196460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:07.230923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 862/1682] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:38:07.230923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:07.249377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590c88-01fc-479d-b19a-5243fe60f9a5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:07.257153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:07.258141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.258561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 821/1683] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:38:07.259142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.259619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.260433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:07.262464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:07.275610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 863/1684] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:07.277251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:07.279358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:07.281874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:07.306980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49debaa4-cbf2-42f2-b96b-c9c95f7b9def admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:07.324895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:07.326083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.327027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.329395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] PATH_INFO: `/v3/projects/98b79ba6b5ae4fdd80b624f77b2a75ba/users/8f37822fcb7940f7828ce52365e3ff85/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.369548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b79ba6b5ae4fdd80b624f77b2a75ba, user_id=8f37822fcb7940f7828ce52365e3ff85, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:07.376479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:07.403681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3014139-8d23-4d75-895f-a107ee8d1be6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:07.408642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7eed3-dd3d-42ee-bf95-dcfb880e1df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:07.409441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7eed3-dd3d-42ee-bf95-dcfb880e1df6 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.409973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7eed3-dd3d-42ee-bf95-dcfb880e1df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.411085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7eed3-dd3d-42ee-bf95-dcfb880e1df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.424989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7eed3-dd3d-42ee-bf95-dcfb880e1df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:07.427167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7eed3-dd3d-42ee-bf95-dcfb880e1df6 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:07.453481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 822/1685] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:07.490278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 864/1686] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:07 2022] PUT /identity/v3/projects/98b79ba6b5ae4fdd80b624f77b2a75ba/users/8f37822fcb7940f7828ce52365e3ff85/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:07.502910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f78a6-fbf4-443e-9b2d-ee84588b564b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.503666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f78a6-fbf4-443e-9b2d-ee84588b564b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.504042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f78a6-fbf4-443e-9b2d-ee84588b564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.571080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:07.599589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-094f78a6-fbf4-443e-9b2d-ee84588b564b None None] MFA Rules not processed for user `8f37822fcb7940f7828ce52365e3ff85`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:07.600882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-094f78a6-fbf4-443e-9b2d-ee84588b564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:07.633807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:07.748889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 823/1687] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:07.750152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f78a6-fbf4-443e-9b2d-ee84588b564b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:07.797098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794dda8-f09a-4531-9b67-27a151d15e03 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:07.804155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:07.804820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.805130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.805410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] PATH_INFO: `/v3/users/e895771e59284b29925b1a774e662c91` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.806704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e895771e59284b29925b1a774e662c91)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:07.808769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:07.897313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f78a6-fbf4-443e-9b2d-ee84588b564b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:07.907507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:07.908419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:07.908775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:07.909681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:07.910504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:07.913875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:08.051517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 824/1688] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:07 2022] POST /identity/v3/projects => generated 405 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:08.057091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:08.088501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e895771e59284b29925b1a774e662c91'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.122446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e895771e59284b29925b1a774e662c91'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.128189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:08.214046 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e895771e59284b29925b1a774e662c91'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.232807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e895771e59284b29925b1a774e662c91'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.237747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e895771e59284b29925b1a774e662c91'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.249599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 865/1689] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:07 2022] DELETE /identity/v3/users/e895771e59284b29925b1a774e662c91 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:08.254823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:08.260760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:08.261050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084f3c-2e46-4741-989b-72ddbfbb9f76 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:08.377804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7635c-2c17-47e4-9bad-3cc26e9d54b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:08.384564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7635c-2c17-47e4-9bad-3cc26e9d54b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:08.384564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7635c-2c17-47e4-9bad-3cc26e9d54b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:08.384564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7635c-2c17-47e4-9bad-3cc26e9d54b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:08.384564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7635c-2c17-47e4-9bad-3cc26e9d54b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:08.385724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7635c-2c17-47e4-9bad-3cc26e9d54b8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:08.386968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d5565-4efa-470c-a1ef-daa4b495ae5d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:08.401358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:08.402461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:08.402748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:08.403023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] PATH_INFO: `/v3/projects/c86081cf9c1b4802a34d4025956756f5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:08.412469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86081cf9c1b4802a34d4025956756f5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:08.415405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:08.503332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 825/1690] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:08 2022] POST /identity/v3/users => generated 309 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:08.523361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:08.524912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:08.525879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:08.559948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:08.565795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:08.574885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:08.595659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 826/1691] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:08.596821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:08.612052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:08.641311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86081cf9c1b4802a34d4025956756f5', 'request_id': 'req-bd63cb4d-a831-4073-ae90-0703312084bb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.651341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4cfa1-a3cc-45e3-8625-39124f8304a3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:08.651514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86081cf9c1b4802a34d4025956756f5', 'request_id': 'req-bd63cb4d-a831-4073-ae90-0703312084bb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.662935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86081cf9c1b4802a34d4025956756f5', 'request_id': 'req-bd63cb4d-a831-4073-ae90-0703312084bb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.774093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] The token cache is being invalidate because project c86081cf9c1b4802a34d4025956756f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:08.774477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.776723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bd63cb4d-a831-4073-ae90-0703312084bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:08.779588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 866/1692] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:08 2022] DELETE /identity/v3/projects/c86081cf9c1b4802a34d4025956756f5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:08.781676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aba1de-5760-4730-8bd7-03bba5abe334 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:08.782036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aba1de-5760-4730-8bd7-03bba5abe334 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:08.782321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aba1de-5760-4730-8bd7-03bba5abe334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:08.830827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:08.833574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:08.833909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:08.835044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:08.836401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:08.841979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:08.883904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 827/1693] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:08.884830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:08.892889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:08.894635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-64aba1de-5760-4730-8bd7-03bba5abe334 None None] MFA Rules not processed for user `419c0e2718cd4140b07cf0c92a18c296`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:08.914362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-64aba1de-5760-4730-8bd7-03bba5abe334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:09.100173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4fcd-f1a4-442e-943e-6eb76c5190e7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:09.117216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:09.117857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.118445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.118764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.129916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:09.164131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:09.167009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:09.181513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 867/1694] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:09.184029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.191536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.192562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.211281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 828/1695] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:09.212463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:09.215696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:09.246686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:09.251050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7af1-de36-48c4-98a9-f9fd6763b214 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:09.254815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:09.274758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0964-4301-4dbe-879f-e41eaf111ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:09.276937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0964-4301-4dbe-879f-e41eaf111ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.277818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0964-4301-4dbe-879f-e41eaf111ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.278173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0964-4301-4dbe-879f-e41eaf111ff7 admin admin] PATH_INFO: `/v3/projects/baa6c52ecbc64832ab00825929f7bbd1/users/d394efd2c8c24e6fa4728e252193cb60/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.285824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 868/1696] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:09.287321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:09.294250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:09.318129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0964-4301-4dbe-879f-e41eaf111ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa6c52ecbc64832ab00825929f7bbd1, user_id=d394efd2c8c24e6fa4728e252193cb60, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:09.320980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0964-4301-4dbe-879f-e41eaf111ff7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:09.434411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 829/1697] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:09 2022] PUT /identity/v3/projects/baa6c52ecbc64832ab00825929f7bbd1/users/d394efd2c8c24e6fa4728e252193cb60/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:09.436247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986cd7b-9a39-4cba-b3a1-1b08bb9eb39a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.438224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986cd7b-9a39-4cba-b3a1-1b08bb9eb39a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.441995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986cd7b-9a39-4cba-b3a1-1b08bb9eb39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.487771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d37c6-1b80-4258-b0c7-c495881df7c0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:09.502808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4986cd7b-9a39-4cba-b3a1-1b08bb9eb39a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:09.506335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4986cd7b-9a39-4cba-b3a1-1b08bb9eb39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:09.661545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:09.662192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.662472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.662748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.672456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 830/1698] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:09.673391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986cd7b-9a39-4cba-b3a1-1b08bb9eb39a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:09.693909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:09.695577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986cd7b-9a39-4cba-b3a1-1b08bb9eb39a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:09.714158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:09.714801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.715089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.715364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.716502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:09.718294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:09.752121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 831/1699] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:09.753476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:09.764251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaee16-af06-4329-ae14-ff3e507dcd19 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:09.771126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:09.771895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.772176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.772457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.773205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:09.773514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:09.775193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:09.803027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 832/1700] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:09.804565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:09.823624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5918-6c41-41b2-9893-d12fd31df5f6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:09.824846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:09.826600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:09.838621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f1f71-c658-4e81-9b76-c29abe7c27ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:09.839316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1f71-c658-4e81-9b76-c29abe7c27ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.839598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1f71-c658-4e81-9b76-c29abe7c27ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.839877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1f71-c658-4e81-9b76-c29abe7c27ad admin admin] PATH_INFO: `/v3/projects/baa6c52ecbc64832ab00825929f7bbd1/users/d394efd2c8c24e6fa4728e252193cb60/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.848807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f1f71-c658-4e81-9b76-c29abe7c27ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa6c52ecbc64832ab00825929f7bbd1, user_id=d394efd2c8c24e6fa4728e252193cb60, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:09.849001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 869/1701] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:09.850161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:09.852814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f1f71-c658-4e81-9b76-c29abe7c27ad admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:09.878447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26c90-7089-4372-9ebb-2a18a46a7d41 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:09.902902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 833/1702] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:09 2022] PUT /identity/v3/projects/baa6c52ecbc64832ab00825929f7bbd1/users/d394efd2c8c24e6fa4728e252193cb60/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:09.904992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:09.905321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:09.905600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:09.981692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] MFA Rules not processed for user `d394efd2c8c24e6fa4728e252193cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:09.986805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:10.012100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:10.013914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.015654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.016404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:10.018059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:10.025824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:10.054261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:10.129249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 834/1703] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:10.147698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 870/1704] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:10.148019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:10.149841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:10.152185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:10.368132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35535f21-5a68-4564-b00d-33186bdfab25 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:10.376323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb0427-c121-4d13-aa0f-e36e010c35af admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:10.404736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:10.406452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.406978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.407400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:10.408272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:10.411023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:10.504673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:10.505376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.505749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.505914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:10.553585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 871/1705] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:10 2022] POST /identity/v3/users => generated 294 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:10.566796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:10.596710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bc741-6cff-49ff-82f1-b36a1eef9224 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:10.614334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:10.615214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.615498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.615873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:10.616660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:10.618402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:10.642081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 872/1706] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:10.648330 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:10.652542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:10.654037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:10.670847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21fddd-7c9a-4edb-b8b9-1ccfc647be26 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:10.681932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:10.686610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.687088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.687435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:10.688219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:10.691830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 835/1707] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:10 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:10.692665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:10.764567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 873/1708] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:10.766789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:10.804453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bed8af-15a7-424b-b4a0-17f80924eeae service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:10.817382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69029783-38d8-49fc-94d2-669bed32fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:10.818266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69029783-38d8-49fc-94d2-669bed32fbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.821117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69029783-38d8-49fc-94d2-669bed32fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.821608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69029783-38d8-49fc-94d2-669bed32fbb5 admin admin] PATH_INFO: `/v3/projects/5c6f13efa97e481486409a3cdd4e6a7a/users/46166e4323444f4091b8939bc66fc660/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:10.888645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69029783-38d8-49fc-94d2-669bed32fbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6f13efa97e481486409a3cdd4e6a7a, user_id=46166e4323444f4091b8939bc66fc660, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:10.901615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:10.908358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69029783-38d8-49fc-94d2-669bed32fbb5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:10.929588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:10.953466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:10.956608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf83d32-fa95-494c-914d-5187c25e6ef9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:10.965276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:10.966204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.966691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.967185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] PATH_INFO: `/v3/users/8f37822fcb7940f7828ce52365e3ff85` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:10.969866 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f37822fcb7940f7828ce52365e3ff85)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:10.972062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:10.986075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 836/1709] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:10 2022] PUT /identity/v3/projects/5c6f13efa97e481486409a3cdd4e6a7a/users/46166e4323444f4091b8939bc66fc660/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:10.991083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd83bf-4ac4-4a1c-9df1-424f15d1fdea None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:10.991496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd83bf-4ac4-4a1c-9df1-424f15d1fdea None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:10.991717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd83bf-4ac4-4a1c-9df1-424f15d1fdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:11.067191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-73dd83bf-4ac4-4a1c-9df1-424f15d1fdea None None] MFA Rules not processed for user `46166e4323444f4091b8939bc66fc660`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:11.068613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-73dd83bf-4ac4-4a1c-9df1-424f15d1fdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:11.241072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 837/1710] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:38:11.243036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd83bf-4ac4-4a1c-9df1-424f15d1fdea None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:11.265655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f37822fcb7940f7828ce52365e3ff85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:11.285785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f37822fcb7940f7828ce52365e3ff85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:11.380879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f37822fcb7940f7828ce52365e3ff85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:11.437716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd83bf-4ac4-4a1c-9df1-424f15d1fdea None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:11.440552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f37822fcb7940f7828ce52365e3ff85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:11.441618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1a171567-eab8-4ddc-bc18-b636bb672f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f37822fcb7940f7828ce52365e3ff85'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:11.444470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211ae83-2051-46d5-ade8-1eb2cf8d8b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:11.445588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211ae83-2051-46d5-ade8-1eb2cf8d8b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:11.446181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211ae83-2051-46d5-ade8-1eb2cf8d8b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:11.446487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211ae83-2051-46d5-ade8-1eb2cf8d8b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:11.447190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211ae83-2051-46d5-ade8-1eb2cf8d8b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:11.451517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211ae83-2051-46d5-ade8-1eb2cf8d8b9e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:11.460464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 874/1711] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:10 2022] DELETE /identity/v3/users/8f37822fcb7940f7828ce52365e3ff85 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:11.462852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371921-689b-4095-a997-27ee057447b9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:11.463571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371921-689b-4095-a997-27ee057447b9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:11.468237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371921-689b-4095-a997-27ee057447b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:11.598747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ce371921-689b-4095-a997-27ee057447b9 None None] MFA Rules not processed for user `3ecfea42ece24ef095287d27dd752cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:11.598747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce371921-689b-4095-a997-27ee057447b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:11.687591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 838/1712] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:11 2022] POST /identity/v3/projects => generated 389 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:11.689193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabcb08-1c7d-4e27-9f57-764a6ef1c614 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:11.689728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabcb08-1c7d-4e27-9f57-764a6ef1c614 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:11.690008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabcb08-1c7d-4e27-9f57-764a6ef1c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:11.719118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3dabcb08-1c7d-4e27-9f57-764a6ef1c614 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:11.721267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3dabcb08-1c7d-4e27-9f57-764a6ef1c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:11.817064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 875/1713] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:11.818351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce371921-689b-4095-a997-27ee057447b9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:11.821015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce371921-689b-4095-a997-27ee057447b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:11.867381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 839/1714] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:11.893386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:11.894771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:11.895061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:11.924581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] MFA Rules not processed for user `3ecfea42ece24ef095287d27dd752cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:11.925825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:11.960063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce371921-689b-4095-a997-27ee057447b9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:11.965118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:11.966113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:11.966552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:11.967104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:11.968891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:11.971255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:12.041734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 840/1715] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:12.042971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:12.044592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:12.066555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211749ab-41c3-40f0-8f1b-04b5ef80585e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:12.078033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:12.080360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:12.080731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:12.081467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] PATH_INFO: `/v3/projects/24703fa4e70b4c89a5badfccbfae9b9e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:12.087708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 876/1716] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:11 2022] POST /identity/v3/users => generated 301 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:12.087708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:12.087934 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24703fa4e70b4c89a5badfccbfae9b9e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:12.088508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:12.089932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:12.144890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:12.192943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987439b-64d9-4e5d-805a-9bd4365292fe admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:12.199328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:12.215535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:12.218887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:12.219323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:12.238509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24703fa4e70b4c89a5badfccbfae9b9e', 'request_id': 'req-cf102626-f544-4af1-9e4b-7874c3cae681'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.242155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:12.243759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:12.259181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 877/1717] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:12.260601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:12.262118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:12.310829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24703fa4e70b4c89a5badfccbfae9b9e', 'request_id': 'req-cf102626-f544-4af1-9e4b-7874c3cae681'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.331778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24703fa4e70b4c89a5badfccbfae9b9e', 'request_id': 'req-cf102626-f544-4af1-9e4b-7874c3cae681'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.359865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] The token cache is being invalidate because project 24703fa4e70b4c89a5badfccbfae9b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:12.360184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.360871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.367014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 841/1718] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:12 2022] DELETE /identity/v3/projects/24703fa4e70b4c89a5badfccbfae9b9e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:12.368241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:12.370250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:12.375112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992074fe-b8f7-469d-984b-d8d5e787dcf5 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:12.535799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:12.537643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:12.537929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:12.538198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:12.544775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:12.556321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102626-f544-4af1-9e4b-7874c3cae681 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:12.589269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:12.593056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:12.593056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:12.593056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:12.593056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:12.593056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:12.626427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 842/1719] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:12.626427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:12.629671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:12.662071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38089c8-bde5-4b28-96e6-40c3e7639619 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:12.675864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:12.676523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:12.676808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:12.677105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] PATH_INFO: `/v3/users/e07de8ce5e37434ea8faf021dcf5c49a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:12.682154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07de8ce5e37434ea8faf021dcf5c49a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:12.683077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:12.736340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:12.738892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:12.764379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 878/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:12.767180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:12.810672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f74e1-8cd0-4f33-b23d-b03025b70da3 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:12.823730 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e915f-024b-4e8d-85ab-b2759daee4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:12.824431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e915f-024b-4e8d-85ab-b2759daee4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:12.824718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e915f-024b-4e8d-85ab-b2759daee4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:12.824996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e915f-024b-4e8d-85ab-b2759daee4cf admin admin] PATH_INFO: `/v3/projects/1608087f7d194a69a590883be936e764/users/c82efc9a36744b21ac6e1bb94c1067d9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:12.869864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e915f-024b-4e8d-85ab-b2759daee4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1608087f7d194a69a590883be936e764, user_id=c82efc9a36744b21ac6e1bb94c1067d9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:12.876631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e915f-024b-4e8d-85ab-b2759daee4cf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:12.934600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07de8ce5e37434ea8faf021dcf5c49a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.935555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07de8ce5e37434ea8faf021dcf5c49a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.943636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07de8ce5e37434ea8faf021dcf5c49a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.960697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07de8ce5e37434ea8faf021dcf5c49a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.961536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-abd07954-7794-408a-a1ed-2e5c2c93a9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07de8ce5e37434ea8faf021dcf5c49a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:12.979929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:13.001172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 879/1721] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:12 2022] PUT /identity/v3/projects/1608087f7d194a69a590883be936e764/users/c82efc9a36744b21ac6e1bb94c1067d9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:13.013526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.014146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.014445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.074106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 843/1722] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:12 2022] DELETE /identity/v3/users/e07de8ce5e37434ea8faf021dcf5c49a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:13.074106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c217f-4d6d-4d4d-84f8-854f4514f2b9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.074106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c217f-4d6d-4d4d-84f8-854f4514f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.074106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c217f-4d6d-4d4d-84f8-854f4514f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.128428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] MFA Rules not processed for user `47091634f81746e7b68d3e78746e2f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:13.129433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:13.191237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:13.197913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-be7c217f-4d6d-4d4d-84f8-854f4514f2b9 None None] MFA Rules not processed for user `c3713a10f2cb4a6c81a4ca06d6f9a60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:13.199312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-be7c217f-4d6d-4d4d-84f8-854f4514f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:13.361488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 880/1723] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:13.362459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:13.364702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:13.410900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 844/1724] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:13.410900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8addeb-7956-4095-8a3a-5a8d14c0cb16 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.410900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8addeb-7956-4095-8a3a-5a8d14c0cb16 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.410900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8addeb-7956-4095-8a3a-5a8d14c0cb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.466826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-cc8addeb-7956-4095-8a3a-5a8d14c0cb16 None None] MFA Rules not processed for user `30517a4b639c4a76a8f194f910c19720`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:13.470086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cc8addeb-7956-4095-8a3a-5a8d14c0cb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:13.568910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e291a-6953-421a-ad6f-a06f59b3932c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:13.579837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:13.591867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:13.592613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.592804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.593208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.593879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:13.595507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:13.624106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 881/1725] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:13.625780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:13.637794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:13.651183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 845/1726] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:13.658363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572a2c-a74b-4099-9708-93703334feef None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.658662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572a2c-a74b-4099-9708-93703334feef None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.658941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572a2c-a74b-4099-9708-93703334feef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.690487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a7572a2c-a74b-4099-9708-93703334feef None None] MFA Rules not processed for user `c3713a10f2cb4a6c81a4ca06d6f9a60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:13.692049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a7572a2c-a74b-4099-9708-93703334feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:13.699964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 846/1727] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:13.700797 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572a2c-a74b-4099-9708-93703334feef None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:13.713814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572a2c-a74b-4099-9708-93703334feef None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:13.720299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:13.721233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.721513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.721930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] PATH_INFO: `/v3/projects/1608087f7d194a69a590883be936e764/users/c82efc9a36744b21ac6e1bb94c1067d9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.723960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1608087f7d194a69a590883be936e764, user_id=c82efc9a36744b21ac6e1bb94c1067d9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:13.727195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:13.769430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 847/1728] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:13 2022] PUT /identity/v3/projects/1608087f7d194a69a590883be936e764/users/c82efc9a36744b21ac6e1bb94c1067d9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:13.769430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:13.769430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:13.838280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04f3e6-242a-433f-b23e-aa83463e8d42 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:13.961625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:13.962600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.962933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.963215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.972780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb9580-61e6-4077-b5d5-de2c77db6c12 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:13.987059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:13.987812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:13.990511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:13.990824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] PATH_INFO: `/v3/projects/89de93d4746840a48a0387629257bee1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:13.992321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] RBAC: Authorizing `identity:delete_project(project_id=89de93d4746840a48a0387629257bee1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:13.997728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:14.082839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:14.084575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:14.105578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 882/1729] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:14.117854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:14.124009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:14.152204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89de93d4746840a48a0387629257bee1', 'request_id': 'req-746e3bbc-bdfe-4712-93d4-abc29f2f82be'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.153503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97356e9-d9db-4bf9-b579-69c13f893360 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:14.243451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:14.244409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89de93d4746840a48a0387629257bee1', 'request_id': 'req-746e3bbc-bdfe-4712-93d4-abc29f2f82be'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.254506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89de93d4746840a48a0387629257bee1', 'request_id': 'req-746e3bbc-bdfe-4712-93d4-abc29f2f82be'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.272023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:14.273361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:14.275292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:14.275590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] PATH_INFO: `/v3/projects/98b79ba6b5ae4fdd80b624f77b2a75ba` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:14.277062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b79ba6b5ae4fdd80b624f77b2a75ba)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:14.282378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:14.287877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] The token cache is being invalidate because project 89de93d4746840a48a0387629257bee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:14.288786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.289716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-746e3bbc-bdfe-4712-93d4-abc29f2f82be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.291952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 848/1730] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:13 2022] DELETE /identity/v3/projects/89de93d4746840a48a0387629257bee1 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:14.294848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196549e0-ca8d-4aa5-ab49-07598078d635 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:14.295387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196549e0-ca8d-4aa5-ab49-07598078d635 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:14.300938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196549e0-ca8d-4aa5-ab49-07598078d635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:14.395418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-196549e0-ca8d-4aa5-ab49-07598078d635 None None] MFA Rules not processed for user `c82efc9a36744b21ac6e1bb94c1067d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:14.396831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-196549e0-ca8d-4aa5-ab49-07598078d635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:14.559934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b79ba6b5ae4fdd80b624f77b2a75ba', 'request_id': 'req-fb2c59e4-5b39-435e-99a5-753509002836'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.563023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 849/1731] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:14.564029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da36d5-57b3-4314-ad33-8f886f5d0b84 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:14.564398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da36d5-57b3-4314-ad33-8f886f5d0b84 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:14.564779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da36d5-57b3-4314-ad33-8f886f5d0b84 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:14.566477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 850/1732] 10.222.0.60 () {54 vars in 912 bytes} [Fri Sep 9 21:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:38:14.571192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:14.571428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:14.571937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:14.593975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b79ba6b5ae4fdd80b624f77b2a75ba', 'request_id': 'req-fb2c59e4-5b39-435e-99a5-753509002836'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.617196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b79ba6b5ae4fdd80b624f77b2a75ba', 'request_id': 'req-fb2c59e4-5b39-435e-99a5-753509002836'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.633494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:14.641537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:14.733326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] The token cache is being invalidate because project 98b79ba6b5ae4fdd80b624f77b2a75ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:14.734664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.736574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-fb2c59e4-5b39-435e-99a5-753509002836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:14.745522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 883/1733] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:14 2022] DELETE /identity/v3/projects/98b79ba6b5ae4fdd80b624f77b2a75ba => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:14.745522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:14.745522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:14.745522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:14.766641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 851/1734] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:14.769387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:14.773649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:14.856042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] MFA Rules not processed for user `cf39db40dace49cbba29c0596cbe76bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:14.857698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:14.926870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78841-7e75-43d4-bc57-ff59f58cf54e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:14.931997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76810e25-2cd1-4502-8056-e886f101a323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:14.932752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76810e25-2cd1-4502-8056-e886f101a323 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:14.933375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76810e25-2cd1-4502-8056-e886f101a323 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:14.933715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76810e25-2cd1-4502-8056-e886f101a323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:14.939478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-76810e25-2cd1-4502-8056-e886f101a323 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:14.980847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 884/1735] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:14.981851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:14.988864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:15.023035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110e8c-2af8-4e0d-907c-7840003df827 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:15.041123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:15.041845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:15.042131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:15.042407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] PATH_INFO: `/v3/users/d394efd2c8c24e6fa4728e252193cb60` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:15.044278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d394efd2c8c24e6fa4728e252193cb60)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:15.048614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:15.095529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76810e25-2cd1-4502-8056-e886f101a323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:15.106438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76810e25-2cd1-4502-8056-e886f101a323 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:15.138107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 852/1736] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:15.139805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:15.140101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:15.140463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:15.163846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:15.201069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:15.213281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:15.242764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 853/1737] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:15.249939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:15.252739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:15.293405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbcbbe-925b-4e47-9932-5b0c591aec3b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:15.306383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:15.308644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:15.309841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:15.311254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:15.330648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:15.336278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:15.347475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd394efd2c8c24e6fa4728e252193cb60'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:15.356107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd394efd2c8c24e6fa4728e252193cb60'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:15.358131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 854/1738] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:15.360250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:15.378468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401217a-a174-4bde-977c-9f4d6e1cab95 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:15.398250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:15.408781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:15.408781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:15.412845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:15.414463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:15.416089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:15.438897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:15.488395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 855/1739] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:15.489695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:15.496084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:15.506567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd394efd2c8c24e6fa4728e252193cb60'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:15.540850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd394efd2c8c24e6fa4728e252193cb60'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:15.543219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd394efd2c8c24e6fa4728e252193cb60'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:15.593548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ba68-9dda-4a29-9731-24e0b6226575 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:15.598595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 885/1740] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:14 2022] DELETE /identity/v3/users/d394efd2c8c24e6fa4728e252193cb60 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:15.599619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:15.606754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:15.793336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:15.793997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:15.794343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:15.796792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] PATH_INFO: `/v3/users/46166e4323444f4091b8939bc66fc660` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:15.799301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:15.811508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46166e4323444f4091b8939bc66fc660)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:15.818923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a298ba-6354-4116-b48c-30a48e5c96ca admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:15.819500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:15.838343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:15.839026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:15.841862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:15.842157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:15.845579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:15.848049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:16.004907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 886/1741] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:15 2022] POST /identity/v3/projects => generated 401 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:16.009084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:16.106697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a0bb1-152b-46e3-9cbf-332270c24bfb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:16.115777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:16.116513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.116903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.117221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.117871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:16.119835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:16.144008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46166e4323444f4091b8939bc66fc660'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:16.144703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46166e4323444f4091b8939bc66fc660'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:16.164628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46166e4323444f4091b8939bc66fc660'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:16.200019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46166e4323444f4091b8939bc66fc660'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:16.200843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-192600b8-b1f9-4811-a60c-3a6b2fc85218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46166e4323444f4091b8939bc66fc660'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:16.275125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 887/1742] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:16 2022] POST /identity/v3/users => generated 301 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:38:16.279262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:16.282399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:16.299980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 856/1743] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:15 2022] DELETE /identity/v3/users/46166e4323444f4091b8939bc66fc660 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:16.304442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f0d25-4bfa-4a74-b6b9-1408899e05fa None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.304727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f0d25-4bfa-4a74-b6b9-1408899e05fa None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.305178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f0d25-4bfa-4a74-b6b9-1408899e05fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.328805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173acb9-0993-446e-a3b4-48834f88ec8e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:16.356640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5e4f0d25-4bfa-4a74-b6b9-1408899e05fa None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:16.361857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5e4f0d25-4bfa-4a74-b6b9-1408899e05fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:16.478830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:16.479738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c6f6-b3ec-4fe5-b3fe-3f3b94ce06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:16.480649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c6f6-b3ec-4fe5-b3fe-3f3b94ce06de admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.480919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c6f6-b3ec-4fe5-b3fe-3f3b94ce06de admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.481269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c6f6-b3ec-4fe5-b3fe-3f3b94ce06de admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.481927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c6f6-b3ec-4fe5-b3fe-3f3b94ce06de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:16.483898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c6f6-b3ec-4fe5-b3fe-3f3b94ce06de admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:16.499809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 888/1744] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:38:16.501163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c839c-f629-466f-88e1-96b42e75bc48 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.501662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c839c-f629-466f-88e1-96b42e75bc48 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.502001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c839c-f629-466f-88e1-96b42e75bc48 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.505527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 857/1745] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:38:16.506387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f0d25-4bfa-4a74-b6b9-1408899e05fa None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:16.515536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 889/1746] 10.222.0.60 () {54 vars in 912 bytes} [Fri Sep 9 21:38:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:38:16.516786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feae2b-68da-4370-b6a1-78f4cb846e01 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.517102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feae2b-68da-4370-b6a1-78f4cb846e01 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.517381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feae2b-68da-4370-b6a1-78f4cb846e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.532343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f0d25-4bfa-4a74-b6b9-1408899e05fa None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:16.548413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:16.552740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.552740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.552740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.552740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:16.556689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:16.570872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-66feae2b-68da-4370-b6a1-78f4cb846e01 None None] MFA Rules not processed for user `cf39db40dace49cbba29c0596cbe76bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:16.576702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-66feae2b-68da-4370-b6a1-78f4cb846e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:16.584130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 858/1747] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:16.585004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:16.591944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:16.675022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 890/1748] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:16.677078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feae2b-68da-4370-b6a1-78f4cb846e01 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:16.700794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feae2b-68da-4370-b6a1-78f4cb846e01 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:16.712993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5990bd3-4da6-4f58-bf02-cb1599d965e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:16.725180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5990bd3-4da6-4f58-bf02-cb1599d965e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.725471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5990bd3-4da6-4f58-bf02-cb1599d965e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.725754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5990bd3-4da6-4f58-bf02-cb1599d965e0 admin admin] PATH_INFO: `/v3/projects/2095acb9749c4c4b8f917d4b4b08f636/users/a960bfd542464cd8925d38797c06a5db/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.734015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978b6a3-8640-4b41-b760-5fbc6587be6c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:16.746367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:16.748198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.748198 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.749823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.774472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:16.775323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5990bd3-4da6-4f58-bf02-cb1599d965e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2095acb9749c4c4b8f917d4b4b08f636, user_id=a960bfd542464cd8925d38797c06a5db, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:16.779055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:16.783026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5990bd3-4da6-4f58-bf02-cb1599d965e0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:16.802254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 859/1749] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:16.803195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:16.809741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:16.834199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512621-94cd-4f6b-9a06-b7b705ca9d57 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:16.837911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:16.838867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.839344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.839838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.868245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 891/1750] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:16 2022] PUT /identity/v3/projects/2095acb9749c4c4b8f917d4b4b08f636/users/a960bfd542464cd8925d38797c06a5db/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:16.882991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:16.883171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802a81a-9ea0-4251-9066-bb4e812397dc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:16.883287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802a81a-9ea0-4251-9066-bb4e812397dc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:16.883475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802a81a-9ea0-4251-9066-bb4e812397dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:16.888896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:16.912199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 860/1751] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:16.915402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f802a81a-9ea0-4251-9066-bb4e812397dc None None] MFA Rules not processed for user `a960bfd542464cd8925d38797c06a5db`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:16.916685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f802a81a-9ea0-4251-9066-bb4e812397dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:17.000429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:17.002369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:17.015447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 892/1752] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:17.019294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802a81a-9ea0-4251-9066-bb4e812397dc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:17.051217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152e91-4121-43cf-aa93-7fa57011e359 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:17.187143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802a81a-9ea0-4251-9066-bb4e812397dc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:17.207791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:17.208498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:17.208792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:17.209073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:17.211004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:17.214906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:17.225266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:17.226252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:17.226252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:17.226533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] PATH_INFO: `/v3/projects/baa6c52ecbc64832ab00825929f7bbd1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:17.227721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa6c52ecbc64832ab00825929f7bbd1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:17.230054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:17.398633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 893/1753] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:17 2022] POST /identity/v3/projects => generated 401 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:17.410034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:17.415512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:17.429147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa6c52ecbc64832ab00825929f7bbd1', 'request_id': 'req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:17.515945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa6c52ecbc64832ab00825929f7bbd1', 'request_id': 'req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:17.523656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa6c52ecbc64832ab00825929f7bbd1', 'request_id': 'req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:17.551908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] The token cache is being invalidate because project baa6c52ecbc64832ab00825929f7bbd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:17.552252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:17.555887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:17.564206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 861/1754] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:16 2022] DELETE /identity/v3/projects/baa6c52ecbc64832ab00825929f7bbd1 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:17.564206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:17.569899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:17.573893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891da210-ac28-463a-8bbc-f036e3d8c44b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:17.582864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:17.583573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:17.583775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:17.584447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:17.586221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:17.659168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:17.721845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:17.729411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06930ca3-9e92-452a-9b3b-e8df0a52d0d6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:17.771250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:17.772920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:17.784479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 894/1755] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:17.785474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:17.787034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:17.908012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:17.924241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31164826-aa83-41cd-8345-af0d85d9dfc1 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:17.935927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82d52a-05a2-4904-b862-b039878aeb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:17.937710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d52a-05a2-4904-b862-b039878aeb7b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:17.937994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d52a-05a2-4904-b862-b039878aeb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:17.938268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d52a-05a2-4904-b862-b039878aeb7b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:17.939746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82d52a-05a2-4904-b862-b039878aeb7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:17.945725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fb3d9-8d64-4fe8-925b-c0ac460424cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:17.946346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fb3d9-8d64-4fe8-925b-c0ac460424cb service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:17.946627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fb3d9-8d64-4fe8-925b-c0ac460424cb service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:17.946898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fb3d9-8d64-4fe8-925b-c0ac460424cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:17.947605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82d52a-05a2-4904-b862-b039878aeb7b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:17.955072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3b4fb3d9-8d64-4fe8-925b-c0ac460424cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:17.978751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fb3d9-8d64-4fe8-925b-c0ac460424cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:17.981222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fb3d9-8d64-4fe8-925b-c0ac460424cb service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:18.005940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 862/1756] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:18.007407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6f2b-c051-48bc-9f4a-4120cee02212 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.007698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6f2b-c051-48bc-9f4a-4120cee02212 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.007973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6f2b-c051-48bc-9f4a-4120cee02212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.059649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4b6a6f2b-c051-48bc-9f4a-4120cee02212 None None] MFA Rules not processed for user `419c0e2718cd4140b07cf0c92a18c296`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:18.060883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4b6a6f2b-c051-48bc-9f4a-4120cee02212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:18.086425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 895/1757] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:17 2022] POST /identity/v3/users => generated 307 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:18.088109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e5ec-19d7-4e22-8de2-4c1eaf55fa77 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.088402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e5ec-19d7-4e22-8de2-4c1eaf55fa77 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.089009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e5ec-19d7-4e22-8de2-4c1eaf55fa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.160512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0223e5ec-19d7-4e22-8de2-4c1eaf55fa77 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:18.161814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0223e5ec-19d7-4e22-8de2-4c1eaf55fa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:18.194331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 896/1758] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:18.196287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d13c-774e-4e23-891d-d7afa02eb274 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.204313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d13c-774e-4e23-891d-d7afa02eb274 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.205598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d13c-774e-4e23-891d-d7afa02eb274 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.208747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 897/1759] 10.222.0.60 () {54 vars in 961 bytes} [Fri Sep 9 21:38:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:38:18.212889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893048d-407f-4382-ba2e-7dd4a691bc19 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.213924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893048d-407f-4382-ba2e-7dd4a691bc19 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.214209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893048d-407f-4382-ba2e-7dd4a691bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.248036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 863/1760] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:18.249461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6f2b-c051-48bc-9f4a-4120cee02212 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:18.270753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6f2b-c051-48bc-9f4a-4120cee02212 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:18.279154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30958948-3381-4b1e-84a5-fb4a70f219fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:18.279870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958948-3381-4b1e-84a5-fb4a70f219fa admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.281188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958948-3381-4b1e-84a5-fb4a70f219fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.281627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958948-3381-4b1e-84a5-fb4a70f219fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.282301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30958948-3381-4b1e-84a5-fb4a70f219fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:18.287325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c893048d-407f-4382-ba2e-7dd4a691bc19 None None] MFA Rules not processed for user `3ecfea42ece24ef095287d27dd752cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:18.290785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c893048d-407f-4382-ba2e-7dd4a691bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:18.297088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30958948-3381-4b1e-84a5-fb4a70f219fa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:18.310670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 864/1761] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:18.312699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e34ae3-5178-4d97-9349-c02dccdde49d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.312977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e34ae3-5178-4d97-9349-c02dccdde49d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.313293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e34ae3-5178-4d97-9349-c02dccdde49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.339889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e8e34ae3-5178-4d97-9349-c02dccdde49d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:18.339889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e8e34ae3-5178-4d97-9349-c02dccdde49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:18.350412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 865/1762] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:18.351769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dfa3f-99bf-4991-8c91-f8a1aa376584 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.352058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dfa3f-99bf-4991-8c91-f8a1aa376584 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.354368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dfa3f-99bf-4991-8c91-f8a1aa376584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.384529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-523dfa3f-99bf-4991-8c91-f8a1aa376584 None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:18.385796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-523dfa3f-99bf-4991-8c91-f8a1aa376584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:18.408867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 866/1763] 10.222.0.60 () {58 vars in 1058 bytes} [Fri Sep 9 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:18.410839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72fe86-8dcd-4f2f-ac71-a027b0ee2e10 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.411144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72fe86-8dcd-4f2f-ac71-a027b0ee2e10 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.411431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72fe86-8dcd-4f2f-ac71-a027b0ee2e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.467836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6c72fe86-8dcd-4f2f-ac71-a027b0ee2e10 None None] MFA Rules not processed for user `47091634f81746e7b68d3e78746e2f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:18.475325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 898/1764] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:18.476431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893048d-407f-4382-ba2e-7dd4a691bc19 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:18.478080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6c72fe86-8dcd-4f2f-ac71-a027b0ee2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:18.512712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893048d-407f-4382-ba2e-7dd4a691bc19 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:18.528295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:18.528295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.528295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.528295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] PATH_INFO: `/v3/projects/87b3ba7f91ce48a78ddf619e2b880569/users/9016674df6f6451c9fb51c55f41a8450/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.565457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b3ba7f91ce48a78ddf619e2b880569, user_id=9016674df6f6451c9fb51c55f41a8450, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:18.568216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:18.616240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 867/1765] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:18.617216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72fe86-8dcd-4f2f-ac71-a027b0ee2e10 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:18.637772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72fe86-8dcd-4f2f-ac71-a027b0ee2e10 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:18.658381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 899/1766] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:18 2022] PUT /identity/v3/projects/87b3ba7f91ce48a78ddf619e2b880569/users/9016674df6f6451c9fb51c55f41a8450/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:18.659447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:18.663268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:18.663962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.664239 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.664535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.665230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:18.665683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:18.667292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:18.688171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 868/1767] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:18.692106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:18.694018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:18.708379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ed1dd-5b98-4099-9669-6128a1a5798e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:18.733734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:18.756087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d2b5-8d0b-45fc-bb80-5024a3c67b45 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:18.764107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:18.765968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.766257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.766535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.776605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:18.778305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:18.792147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 900/1768] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:18.793127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:18.804274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:18.805395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.805915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.806465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] PATH_INFO: `/v3/projects/5c6f13efa97e481486409a3cdd4e6a7a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.807839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6f13efa97e481486409a3cdd4e6a7a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:18.810093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:18.877516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114641b4-084b-4119-a94f-bda880b2c54c service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:18.887805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:18.888833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.889148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.889470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.891089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:18.893274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:18.919173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 901/1769] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:18.919173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:18.925182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c23c7-7f8d-4a36-9762-afc354559919 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:18.932478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:18.933204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:18.933484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:18.933760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:18.934404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:18.938453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:19.067343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 902/1770] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:18 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:19.067343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:19.103898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6f13efa97e481486409a3cdd4e6a7a', 'request_id': 'req-4f56f011-aa85-4244-9383-a88eac8a9b73'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:19.219001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6f13efa97e481486409a3cdd4e6a7a', 'request_id': 'req-4f56f011-aa85-4244-9383-a88eac8a9b73'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:19.226775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6f13efa97e481486409a3cdd4e6a7a', 'request_id': 'req-4f56f011-aa85-4244-9383-a88eac8a9b73'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:19.256361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] The token cache is being invalidate because project 5c6f13efa97e481486409a3cdd4e6a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:19.256361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:19.257448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:19.261250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8192a00-d3fd-4b28-804e-91758481f6c6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:19.263723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 869/1771] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:18 2022] DELETE /identity/v3/projects/5c6f13efa97e481486409a3cdd4e6a7a => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:19.265346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:19.278029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:19.280865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:19.282729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:19.285071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:19.285071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] PATH_INFO: `/v3/projects/87b3ba7f91ce48a78ddf619e2b880569/users/9016674df6f6451c9fb51c55f41a8450/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:19.287525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b3ba7f91ce48a78ddf619e2b880569, user_id=9016674df6f6451c9fb51c55f41a8450, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:19.296709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:19.349958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 903/1772] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:19 2022] PUT /identity/v3/projects/87b3ba7f91ce48a78ddf619e2b880569/users/9016674df6f6451c9fb51c55f41a8450/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:19.352834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:19.356007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:19.458521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252a554-7f8b-4301-8e9a-8836d40b2c0f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:19.461840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56f011-aa85-4244-9383-a88eac8a9b73 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:19.476736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:19.476906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283ab39-8f7c-448f-b6c7-9c560ea604a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:19.477674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ab39-8f7c-448f-b6c7-9c560ea604a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:19.478093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ab39-8f7c-448f-b6c7-9c560ea604a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:19.480430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ab39-8f7c-448f-b6c7-9c560ea604a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:19.480865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283ab39-8f7c-448f-b6c7-9c560ea604a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:19.480972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:19.481588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:19.481872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:19.482144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] PATH_INFO: `/v3/users/c82efc9a36744b21ac6e1bb94c1067d9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:19.483630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283ab39-8f7c-448f-b6c7-9c560ea604a9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:19.483761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82efc9a36744b21ac6e1bb94c1067d9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:19.497432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:19.970806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 870/1773] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:19 2022] POST /identity/v3/users => generated 286 bytes in 706 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:19.972165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c942b-ce72-4498-9c62-d82280d3a6c4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:19.972499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c942b-ce72-4498-9c62-d82280d3a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:19.972785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c942b-ce72-4498-9c62-d82280d3a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:20.018540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bb6c942b-ce72-4498-9c62-d82280d3a6c4 None None] MFA Rules not processed for user `9016674df6f6451c9fb51c55f41a8450`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:20.020033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bb6c942b-ce72-4498-9c62-d82280d3a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:20.131556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 871/1774] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:20.132454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c942b-ce72-4498-9c62-d82280d3a6c4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:20.151945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82efc9a36744b21ac6e1bb94c1067d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:20.167861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c942b-ce72-4498-9c62-d82280d3a6c4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:20.180297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82efc9a36744b21ac6e1bb94c1067d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:20.181728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:20.182542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:20.182835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:20.183713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:20.184378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:20.188458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:20.213578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 872/1775] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:20.214490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:20.220531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:20.340055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82efc9a36744b21ac6e1bb94c1067d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:20.366363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5521b-18e2-41f9-8dab-ec723924190e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:20.380870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:20.381541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:20.381904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:20.382306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:20.397212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82efc9a36744b21ac6e1bb94c1067d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:20.399211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82efc9a36744b21ac6e1bb94c1067d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:20.407704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:20.414175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:20.418617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 904/1776] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:19 2022] DELETE /identity/v3/users/c82efc9a36744b21ac6e1bb94c1067d9 => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:20.420257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:20.444357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:20.485440 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 873/1777] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:20.638233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fd669-0c7f-4a75-b503-7ef5f3e6882e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:20.646421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:20.647141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:20.647500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:20.647869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:20.649149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:20.650971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:20.657969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:20.682140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 905/1778] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:20.686946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:20.702661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693d91-759c-4511-8477-ba723c010a87 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:20.710432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c31fc-e193-419d-a9ae-6ba514420eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:20.712651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c31fc-e193-419d-a9ae-6ba514420eac admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:20.713736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c31fc-e193-419d-a9ae-6ba514420eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:20.715601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c31fc-e193-419d-a9ae-6ba514420eac admin admin] PATH_INFO: `/v3/projects/4a9c49b6320a404289e5bcee1f163212/users/d37f58255fc040c29740f8ca45d28037/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:20.737745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c31fc-e193-419d-a9ae-6ba514420eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9c49b6320a404289e5bcee1f163212, user_id=d37f58255fc040c29740f8ca45d28037, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:20.741784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c31fc-e193-419d-a9ae-6ba514420eac admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:20.763308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:20.765492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:20.865585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 874/1779] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:20 2022] PUT /identity/v3/projects/4a9c49b6320a404289e5bcee1f163212/users/d37f58255fc040c29740f8ca45d28037/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:20.879677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a34fa-ac44-4f3f-bc92-96b94f73f19a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:20.880145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a34fa-ac44-4f3f-bc92-96b94f73f19a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:20.880579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a34fa-ac44-4f3f-bc92-96b94f73f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:20.963831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6a7a34fa-ac44-4f3f-bc92-96b94f73f19a None None] MFA Rules not processed for user `d37f58255fc040c29740f8ca45d28037`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:20.964832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c740-ca94-454d-a3c5-eaf1d75d6f65 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:20.975975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6a7a34fa-ac44-4f3f-bc92-96b94f73f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:21.150484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 875/1780] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:21.156872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a34fa-ac44-4f3f-bc92-96b94f73f19a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:21.183240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:21.184291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:21.185930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:21.186420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:21.199990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:21.315043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a34fa-ac44-4f3f-bc92-96b94f73f19a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:21.338703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:21.339355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:21.339638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:21.339916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:21.340567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:21.351575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:21.367508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:21.369086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:21.382675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 906/1781] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:21.532828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 876/1782] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:21 2022] POST /identity/v3/projects => generated 371 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:21.537135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:21.550240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a554c3-54f8-478a-8a78-f272fa081076 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:21.570359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:21.572140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:21.769395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:21.770879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:21.771868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:21.772816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:21.773890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:21.779660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:21.793819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204364c-6b1c-4e5d-a562-64185b634e18 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:21.807312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:21.830702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:21.833288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:21.833596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] PATH_INFO: `/v3/projects/1608087f7d194a69a590883be936e764` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:21.839825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1608087f7d194a69a590883be936e764)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:21.847755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:21.952420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 907/1783] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:21 2022] POST /identity/v3/users => generated 292 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:21.956633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:21.975526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794735e8-44fe-412c-a6cd-59fac4138d6f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:21.981294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:21.981915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:21.982191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:21.982460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:21.984566 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:21.986659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:22.009079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 908/1784] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:22.011735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:22.033425 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b89016-4f49-4225-8bab-1eb0ce223036 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:22.061162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:22.064353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.065381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.065381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] PATH_INFO: `/v3/projects/ca456c38c0f64eb8b8e15251302ac807/users/8e1a599cc46644a5a684cb6776f47cce/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.068379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1608087f7d194a69a590883be936e764', 'request_id': 'req-c546d29f-4b28-4075-a90c-a3ee90a67970'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:22.103624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca456c38c0f64eb8b8e15251302ac807, user_id=8e1a599cc46644a5a684cb6776f47cce, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:22.122729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:22.167743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1608087f7d194a69a590883be936e764', 'request_id': 'req-c546d29f-4b28-4075-a90c-a3ee90a67970'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:22.180354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1608087f7d194a69a590883be936e764', 'request_id': 'req-c546d29f-4b28-4075-a90c-a3ee90a67970'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:22.209889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] The token cache is being invalidate because project 1608087f7d194a69a590883be936e764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:22.210210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:22.211627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c546d29f-4b28-4075-a90c-a3ee90a67970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:22.216181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 877/1785] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:21 2022] DELETE /identity/v3/projects/1608087f7d194a69a590883be936e764 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:22.222563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191230d-9562-4b44-adde-bc13be996ac9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.222875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191230d-9562-4b44-adde-bc13be996ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.223155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191230d-9562-4b44-adde-bc13be996ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.283600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:22.298886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4191230d-9562-4b44-adde-bc13be996ac9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:22.308457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4191230d-9562-4b44-adde-bc13be996ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:22.338561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 909/1786] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:22 2022] PUT /identity/v3/projects/ca456c38c0f64eb8b8e15251302ac807/users/8e1a599cc46644a5a684cb6776f47cce/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:22.339595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:22.345243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:22.457424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 878/1787] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:38:22.457424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5a11-f3fa-48b3-b977-2148544c3693 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.457424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5a11-f3fa-48b3-b977-2148544c3693 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.457782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5a11-f3fa-48b3-b977-2148544c3693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.465059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6744-2f89-4994-a467-49f732f467e4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:22.471355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:22.472165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.472455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.472796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.473549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:22.476891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:22.499351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a78a5a11-f3fa-48b3-b977-2148544c3693 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:22.499351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a78a5a11-f3fa-48b3-b977-2148544c3693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:22.505079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 879/1788] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:22.508242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 910/1789] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:22.508364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a5a11-f3fa-48b3-b977-2148544c3693 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:22.509197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:22.521314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12511c06-53c1-41a2-91dd-410ab5a060da admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:22.541436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a5a11-f3fa-48b3-b977-2148544c3693 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:22.541653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e9c81-0895-428b-82e2-c41b28a76127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:22.547024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e9c81-0895-428b-82e2-c41b28a76127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.548955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e9c81-0895-428b-82e2-c41b28a76127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.549449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e9c81-0895-428b-82e2-c41b28a76127 admin admin] PATH_INFO: `/v3/projects/ca456c38c0f64eb8b8e15251302ac807/users/8e1a599cc46644a5a684cb6776f47cce/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.550416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:22.551252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.551706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.552152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.552983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:22.553464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:22.555225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:22.555337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e9c81-0895-428b-82e2-c41b28a76127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca456c38c0f64eb8b8e15251302ac807, user_id=8e1a599cc46644a5a684cb6776f47cce, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:22.557972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e9c81-0895-428b-82e2-c41b28a76127 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:22.577188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 880/1791] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:22.581411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:22.582744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 911/1791] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:22 2022] PUT /identity/v3/projects/ca456c38c0f64eb8b8e15251302ac807/users/8e1a599cc46644a5a684cb6776f47cce/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:22.584778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.585093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.585389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.602743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0270-92a7-422a-b53e-5911b7b81d01 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:22.619943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] MFA Rules not processed for user `8e1a599cc46644a5a684cb6776f47cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:22.622439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:22.803010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 912/1792] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:38:22.810155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:22.811457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.813405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.815437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.816249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:22.818363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:22.819671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:22.832517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:22.966119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0171a8d-c106-415e-a830-f1f837f5abf0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:22.975404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 881/1793] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:22 2022] POST /identity/v3/projects => generated 383 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:38:22.978785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:22.979498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:22.979786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:22.980706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:22.981082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:23.010768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:23.012500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:23.036056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 913/1794] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:23.119708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad129cd-f9df-43eb-bf81-200c05cde627 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:23.127744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:23.128849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:23.129251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:23.129602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:23.130486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:23.133299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:23.314756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 882/1795] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:22 2022] POST /identity/v3/users => generated 292 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:23.316166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:23.336426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420aa8-3974-4237-bbcf-513e2d08ce88 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:23.358731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:23.359444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:23.359764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:23.360110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:23.361164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:23.364593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:23.379303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:23.405489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:23.411493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 914/1796] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:38:23.412469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:23.439003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70b61-ba9d-486b-9f31-1d663a2086b0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:23.497714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:23.499153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:23.500237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:23.501395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:23.502135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:23.504187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:23.521560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 915/1797] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:23.527662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:23.541264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28aa98-dcac-4b0d-9698-d5d16138c70a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:23.549298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:23.550116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:23.550644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:23.551159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] PATH_INFO: `/v3/projects/9b9924fa49a348c28c133ea006c39dff/users/d2e0ce6287b34a16a64b94ddb06fcfc0/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:23.560610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18d093-0884-406b-84ad-6f3a027408a0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:23.565669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222046f2-80e6-41e7-93c0-756f533cffc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:23.566876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222046f2-80e6-41e7-93c0-756f533cffc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:23.567337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222046f2-80e6-41e7-93c0-756f533cffc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:23.567615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222046f2-80e6-41e7-93c0-756f533cffc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:23.570360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-222046f2-80e6-41e7-93c0-756f533cffc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:23.571674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9924fa49a348c28c133ea006c39dff, user_id=d2e0ce6287b34a16a64b94ddb06fcfc0, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:23.574922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:23.651276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222046f2-80e6-41e7-93c0-756f533cffc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:23.653674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222046f2-80e6-41e7-93c0-756f533cffc6 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:23.665468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 883/1798] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:23.672735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 916/1799] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:23 2022] PUT /identity/v3/projects/9b9924fa49a348c28c133ea006c39dff/users/d2e0ce6287b34a16a64b94ddb06fcfc0/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:23.683682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868af8-c5d9-4fb3-b3c2-02c181c70511 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:23.683976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868af8-c5d9-4fb3-b3c2-02c181c70511 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:23.684255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868af8-c5d9-4fb3-b3c2-02c181c70511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:23.742886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6d868af8-c5d9-4fb3-b3c2-02c181c70511 None None] MFA Rules not processed for user `d2e0ce6287b34a16a64b94ddb06fcfc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:23.742886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6d868af8-c5d9-4fb3-b3c2-02c181c70511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:23.904933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 884/1800] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:24.196607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:24.260522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:24.343219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ba646-ef3e-4637-8010-a09bd9cfb240 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:24.346837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd408f5-befb-43af-b433-3de8354787d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:24.347519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd408f5-befb-43af-b433-3de8354787d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:24.347870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd408f5-befb-43af-b433-3de8354787d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:24.348213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd408f5-befb-43af-b433-3de8354787d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:24.356735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd408f5-befb-43af-b433-3de8354787d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:24.358410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd408f5-befb-43af-b433-3de8354787d5 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:24.367616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 917/1801] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:24.387293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d868af8-c5d9-4fb3-b3c2-02c181c70511 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:24.509162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d868af8-c5d9-4fb3-b3c2-02c181c70511 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:24.515033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:24.515697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:24.515985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:24.516259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] PATH_INFO: `/v3/users/d2e0ce6287b34a16a64b94ddb06fcfc0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:24.517784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e0ce6287b34a16a64b94ddb06fcfc0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:24.519978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:24.653876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb20736-949a-4a52-8ad8-68395b9e6a80 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:24.654192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb20736-949a-4a52-8ad8-68395b9e6a80 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:24.654642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb20736-949a-4a52-8ad8-68395b9e6a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:24.723975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9cb20736-949a-4a52-8ad8-68395b9e6a80 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:24.725659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9cb20736-949a-4a52-8ad8-68395b9e6a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:24.813178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e0ce6287b34a16a64b94ddb06fcfc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:24.816662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e0ce6287b34a16a64b94ddb06fcfc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:24.840939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e0ce6287b34a16a64b94ddb06fcfc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:24.843740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 918/1802] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:24.875286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e0ce6287b34a16a64b94ddb06fcfc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:24.876502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e0ce6287b34a16a64b94ddb06fcfc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:24.992617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 885/1803] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:24 2022] DELETE /identity/v3/users/d2e0ce6287b34a16a64b94ddb06fcfc0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:24.997395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:24.997688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:24.997970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:25.039312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:25.040710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:25.140423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 919/1804] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:25.150875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:25.152422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:25.236448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:25.238101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:25.258909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb1079-6547-4e69-9b5e-085a6c5de7b6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:25.262941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca956a4-ebaf-4200-bb3b-ffaea9611314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:25.263629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca956a4-ebaf-4200-bb3b-ffaea9611314 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:25.263910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca956a4-ebaf-4200-bb3b-ffaea9611314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:25.264276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca956a4-ebaf-4200-bb3b-ffaea9611314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:25.302974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca956a4-ebaf-4200-bb3b-ffaea9611314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:25.304951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca956a4-ebaf-4200-bb3b-ffaea9611314 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:25.330976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 886/1805] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:25.383257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e17b-831f-449c-91d4-ceccaff92743 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:25.390529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:25.391161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:25.391447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:25.391733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:25.394515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:25.512775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:25.516393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:25.561936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 920/1806] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:38:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:38:25.743699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:25.751391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:25.751391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:25.825898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] MFA Rules not processed for user `cf39db40dace49cbba29c0596cbe76bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:25.828073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:25.846499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 887/1807] 10.222.0.50 () {58 vars in 1015 bytes} [Fri Sep 9 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:25.871415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:25.872854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:25.910349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2f7a-7742-4e54-b2af-37c79fe5fb96 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:25.921340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99be62-aaf2-4b6a-bdca-b389ed5ac815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:25.922146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99be62-aaf2-4b6a-bdca-b389ed5ac815 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:25.922340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99be62-aaf2-4b6a-bdca-b389ed5ac815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:25.922576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99be62-aaf2-4b6a-bdca-b389ed5ac815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:25.938517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99be62-aaf2-4b6a-bdca-b389ed5ac815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:25.939983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99be62-aaf2-4b6a-bdca-b389ed5ac815 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:25.959111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 921/1808] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:26.059958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:26.158631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:27.449402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:27.459586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:27.521844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af7207-d345-477d-8be8-6f5e9408fcc8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:27.553282 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:27.554640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:27.555134 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:27.555657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] PATH_INFO: `/v3/projects/9b9924fa49a348c28c133ea006c39dff` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:27.558238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9924fa49a348c28c133ea006c39dff)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:27.561141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:27.707153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9924fa49a348c28c133ea006c39dff', 'request_id': 'req-070c3e0c-ea70-47cb-aae6-749f86df35f1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:27.819286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9924fa49a348c28c133ea006c39dff', 'request_id': 'req-070c3e0c-ea70-47cb-aae6-749f86df35f1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:27.831078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9924fa49a348c28c133ea006c39dff', 'request_id': 'req-070c3e0c-ea70-47cb-aae6-749f86df35f1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:27.832276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:27.913262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] The token cache is being invalidate because project 9b9924fa49a348c28c133ea006c39dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:27.914047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:27.915168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-070c3e0c-ea70-47cb-aae6-749f86df35f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:27.927893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 888/1809] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:27 2022] DELETE /identity/v3/projects/9b9924fa49a348c28c133ea006c39dff => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:27.929419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4210-3d5b-497a-81e4-000b28374791 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:27.929907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4210-3d5b-497a-81e4-000b28374791 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:27.931221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4210-3d5b-497a-81e4-000b28374791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:27.983542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-345a4210-3d5b-497a-81e4-000b28374791 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:27.986843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-345a4210-3d5b-497a-81e4-000b28374791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:28.159699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:28.187778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 922/1810] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:28.189268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236442-37ee-4e14-a3a5-1a50f1c539a8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:28.189577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236442-37ee-4e14-a3a5-1a50f1c539a8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:28.189810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236442-37ee-4e14-a3a5-1a50f1c539a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:28.241831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9e236442-37ee-4e14-a3a5-1a50f1c539a8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:28.243407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9e236442-37ee-4e14-a3a5-1a50f1c539a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:28.294188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 889/1811] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:28.299545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a4210-3d5b-497a-81e4-000b28374791 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:28.310710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a4210-3d5b-497a-81e4-000b28374791 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:28.333941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:28.334604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:28.335782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:28.337104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:28.341728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:28.341728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:28.341728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:28.379894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 923/1812] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:28.384648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236442-37ee-4e14-a3a5-1a50f1c539a8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:28.421196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236442-37ee-4e14-a3a5-1a50f1c539a8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:28.434689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:28.437163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:28.437604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:28.439638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:28.440301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:28.447528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:28.502226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:28.516844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:28.548397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2835caa-596c-4a2c-9eb8-33e668d962b9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:28.580601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:28.581729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:28.582467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:28.582937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] PATH_INFO: `/v3/users/a960bfd542464cd8925d38797c06a5db` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:28.584814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a960bfd542464cd8925d38797c06a5db)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:28.601411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:28.663459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 890/1813] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:28 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:28.664416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:28.785346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76099e3b-1928-4e32-84c4-86e2f5f33644 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:28.792553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:28.797526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:28.797526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:28.797526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:28.797526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:28.804800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:28.976083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a960bfd542464cd8925d38797c06a5db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:28.985078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a960bfd542464cd8925d38797c06a5db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:29.000322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 891/1814] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:28 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:29.005517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:29.026990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f6a2-5827-42a4-a868-9f78cf032c9e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:29.041648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:29.042315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.042664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.043006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.043991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:29.053922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:29.105586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 892/1815] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:38:29.106482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:29.110308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a960bfd542464cd8925d38797c06a5db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:29.137681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d6d48-bb70-4f18-b749-291a70b8fd16 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:29.144867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d73758-a510-4def-90d1-207facfe1d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:29.149498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73758-a510-4def-90d1-207facfe1d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.149899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73758-a510-4def-90d1-207facfe1d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.150276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73758-a510-4def-90d1-207facfe1d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.151971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d73758-a510-4def-90d1-207facfe1d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:29.158034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d73758-a510-4def-90d1-207facfe1d79 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:29.169552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a960bfd542464cd8925d38797c06a5db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:29.173883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee346af1-f0fb-4cbd-ae9b-75cd87906685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a960bfd542464cd8925d38797c06a5db'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:29.180385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 893/1816] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:29.182137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29024b95-23da-474a-827d-f6ef9026de69 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.182769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29024b95-23da-474a-827d-f6ef9026de69 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.183290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29024b95-23da-474a-827d-f6ef9026de69 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.185067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 894/1817] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:38:29.186293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29024b95-23da-474a-827d-f6ef9026de69 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:29.188473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-29024b95-23da-474a-827d-f6ef9026de69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:29.198992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 924/1818] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:28 2022] DELETE /identity/v3/users/a960bfd542464cd8925d38797c06a5db => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:29.204571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5c94-ab2e-49ee-b4d1-c03d081e05d1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.204889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5c94-ab2e-49ee-b4d1-c03d081e05d1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.206732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5c94-ab2e-49ee-b4d1-c03d081e05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.227318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29024b95-23da-474a-827d-f6ef9026de69 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:29.293019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:29.295087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cbda5c94-ab2e-49ee-b4d1-c03d081e05d1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:29.299773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cbda5c94-ab2e-49ee-b4d1-c03d081e05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:29.406686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 925/1819] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:29.408606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e536f-3e02-4a0c-939c-01619bf5f2e9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.409112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e536f-3e02-4a0c-939c-01619bf5f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.409547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e536f-3e02-4a0c-939c-01619bf5f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.424474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:29.428146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.428146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.428146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] PATH_INFO: `/v3/projects/7ec222764ae542379ce0f25d8adebef1/users/bd118a4c9a1a46d688ca311bbd2e7828/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.463176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec222764ae542379ce0f25d8adebef1, user_id=bd118a4c9a1a46d688ca311bbd2e7828, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:29.466446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:29.493488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-930e536f-3e02-4a0c-939c-01619bf5f2e9 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:29.494734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-930e536f-3e02-4a0c-939c-01619bf5f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:29.578626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 895/1820] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:29 2022] PUT /identity/v3/projects/7ec222764ae542379ce0f25d8adebef1/users/bd118a4c9a1a46d688ca311bbd2e7828/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:29.579766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:29.589964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:29.732051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 926/1821] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:38:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:29.735220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.738424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.738424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.770740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720925-77d8-4c1f-91e6-00ed15cafc37 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:29.781069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:29.781838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:29.782135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:29.790074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:29.806014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] MFA Rules not processed for user `bd118a4c9a1a46d688ca311bbd2e7828`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:29.808277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:29.922037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:29.927843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:29.952972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 896/1822] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:30.004196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 927/1823] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:30.005943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:30.033055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d43f2f-7e2e-4919-a8ce-6aedd41214e7 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:30.067498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:30.067498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:30.067498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:30.067498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:30.068206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:30.068206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:30.313879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:30.315422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:30.533674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df79e-e156-4719-b960-b5f00c6a6652 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:30.533674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:30.533674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:30.533674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:30.535574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:30.535574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:30.535574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:30.535574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 928/1824] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:30.683653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 897/1825] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:30 2022] POST /identity/v3/projects => generated 373 bytes in 679 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:30.687447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:30.700256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c74b71-7864-4fe0-8847-e505fb0150aa service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:30.818206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:30.905254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:30.905254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:30.905254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:30.905254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:30.905254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:31.291317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:31.359917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 929/1826] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:30 2022] POST /identity/v3/users => generated 293 bytes in 673 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:31.364601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:31.379320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fec67-d89c-4ef1-9b68-45ea8c0f946c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:31.392564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:31.395464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:31.396460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:31.397371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:31.399356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:31.406942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:31.441159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 898/1827] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:31.444549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:31.454931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef203d-8f46-46f4-9e47-4a310ef49b4a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:31.464756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:31.466702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:31.467552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:31.477429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] PATH_INFO: `/v3/projects/3540742581214c82a925d4eb9f2c491b/users/fa2c23c356e84cd8bdf5634e58d0d010/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:31.530475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3540742581214c82a925d4eb9f2c491b, user_id=fa2c23c356e84cd8bdf5634e58d0d010, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:31.540618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:31.651457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 930/1828] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:31 2022] PUT /identity/v3/projects/3540742581214c82a925d4eb9f2c491b/users/fa2c23c356e84cd8bdf5634e58d0d010/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:31.656035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:31.671613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff3a96-e714-43c3-b2fa-980c3488fd37 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:31.815629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f6548-b200-42b0-b349-209833d40199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:31.816680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6548-b200-42b0-b349-209833d40199 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:31.817231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6548-b200-42b0-b349-209833d40199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:31.817804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6548-b200-42b0-b349-209833d40199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:31.819359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f6548-b200-42b0-b349-209833d40199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:31.821569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f6548-b200-42b0-b349-209833d40199 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:31.846069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:31.847328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 899/1829] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:31.875192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4f080-fd9f-496e-b2f2-17b81ffaa36b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:31.887096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:31.888031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:31.888476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:31.889164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] PATH_INFO: `/v3/projects/3540742581214c82a925d4eb9f2c491b/users/fa2c23c356e84cd8bdf5634e58d0d010/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:31.896336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3540742581214c82a925d4eb9f2c491b, user_id=fa2c23c356e84cd8bdf5634e58d0d010, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:31.899085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:31.926381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 931/1830] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:31 2022] PUT /identity/v3/projects/3540742581214c82a925d4eb9f2c491b/users/fa2c23c356e84cd8bdf5634e58d0d010/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:31.938263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639c81-9523-4ba2-90ea-f5fd6453baec None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:31.938843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639c81-9523-4ba2-90ea-f5fd6453baec None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:31.939283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639c81-9523-4ba2-90ea-f5fd6453baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:31.999357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:32.008260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-71639c81-9523-4ba2-90ea-f5fd6453baec None None] MFA Rules not processed for user `fa2c23c356e84cd8bdf5634e58d0d010`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:32.009552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-71639c81-9523-4ba2-90ea-f5fd6453baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:32.203685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 900/1831] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:32.216848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:32.220357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:32.395867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ca399-5141-4793-93da-f2397b40a338 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:32.400819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92193325-7aef-40f7-a00d-8725baf67ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:32.402234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92193325-7aef-40f7-a00d-8725baf67ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:32.402864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92193325-7aef-40f7-a00d-8725baf67ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:32.403606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92193325-7aef-40f7-a00d-8725baf67ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:32.554929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92193325-7aef-40f7-a00d-8725baf67ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:32.557789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92193325-7aef-40f7-a00d-8725baf67ee8 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:32.576769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 932/1832] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:32.729266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:32.973344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbf4f-5fa1-4cde-95c1-b8299dfd4c32 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:32.973626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbf4f-5fa1-4cde-95c1-b8299dfd4c32 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:32.974799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadbf4f-5fa1-4cde-95c1-b8299dfd4c32 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:32.976908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 901/1833] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:38:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:38:33.097916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b87e4-a35d-42fe-922b-afcc30a7ad23 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:33.098959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b87e4-a35d-42fe-922b-afcc30a7ad23 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:33.099353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b87e4-a35d-42fe-922b-afcc30a7ad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:33.146228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbf4f-5fa1-4cde-95c1-b8299dfd4c32 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:33.149378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2aadbf4f-5fa1-4cde-95c1-b8299dfd4c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:33.188657 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a90b87e4-a35d-42fe-922b-afcc30a7ad23 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:33.190202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a90b87e4-a35d-42fe-922b-afcc30a7ad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:33.316747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadbf4f-5fa1-4cde-95c1-b8299dfd4c32 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:33.320747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:33.321801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:33.322787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:33.323276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] PATH_INFO: `/v3/projects/2095acb9749c4c4b8f917d4b4b08f636` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:33.327638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2095acb9749c4c4b8f917d4b4b08f636)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:33.350200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 933/1834] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:38:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:33.352707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:33.380611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b87e4-a35d-42fe-922b-afcc30a7ad23 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:33.403615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b87e4-a35d-42fe-922b-afcc30a7ad23 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:33.420599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:33.420599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:33.420599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:33.420599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:33.439602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:33.443877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:33.464527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 934/1835] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:33.589571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2095acb9749c4c4b8f917d4b4b08f636', 'request_id': 'req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:33.709952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2095acb9749c4c4b8f917d4b4b08f636', 'request_id': 'req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:33.717660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2095acb9749c4c4b8f917d4b4b08f636', 'request_id': 'req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:33.750591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] The token cache is being invalidate because project 2095acb9749c4c4b8f917d4b4b08f636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:33.769930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:33.771436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:33.782605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 902/1836] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:33 2022] DELETE /identity/v3/projects/2095acb9749c4c4b8f917d4b4b08f636 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:33.782834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:33.793051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d6fe-78ed-466d-a272-35163e7f6ac1 service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:33.875297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:33.940689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:33.941685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:33.942198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:33.942613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] PATH_INFO: `/v3/users/9016674df6f6451c9fb51c55f41a8450` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:33.944055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9016674df6f6451c9fb51c55f41a8450)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:33.946363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:34.296824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9016674df6f6451c9fb51c55f41a8450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:34.296824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9016674df6f6451c9fb51c55f41a8450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:34.464381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9016674df6f6451c9fb51c55f41a8450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:34.482482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9016674df6f6451c9fb51c55f41a8450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:34.484157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9016674df6f6451c9fb51c55f41a8450'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:34.514793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 935/1837] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:33 2022] DELETE /identity/v3/users/9016674df6f6451c9fb51c55f41a8450 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:37.384479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:37.390219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:37.416868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313ec7a-b1cd-4eeb-9b68-7e9b625b784f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:37.571584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:37.572251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:37.572533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:37.572888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] PATH_INFO: `/v3/users/bd118a4c9a1a46d688ca311bbd2e7828` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:37.586179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd118a4c9a1a46d688ca311bbd2e7828)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:37.588823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:37.719999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:37.726713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:37.732973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:37.776816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ebfdc-a1a4-491a-9a7c-6b332359c41b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:37.782741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:37.803384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:37.805746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:37.806376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:37.806954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] PATH_INFO: `/v3/projects/87b3ba7f91ce48a78ddf619e2b880569` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:37.808668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b3ba7f91ce48a78ddf619e2b880569)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:37.811761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:37.927731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd118a4c9a1a46d688ca311bbd2e7828'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:37.928448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd118a4c9a1a46d688ca311bbd2e7828'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:37.951558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd118a4c9a1a46d688ca311bbd2e7828'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.025651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd118a4c9a1a46d688ca311bbd2e7828'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.027515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f4444f09-3b3c-40f1-8915-e9cf8e0f2a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd118a4c9a1a46d688ca311bbd2e7828'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.056901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b3ba7f91ce48a78ddf619e2b880569', 'request_id': 'req-1b38811a-6f3b-4541-b821-ce570ec8af1e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.090100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b3ba7f91ce48a78ddf619e2b880569', 'request_id': 'req-1b38811a-6f3b-4541-b821-ce570ec8af1e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.107694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b3ba7f91ce48a78ddf619e2b880569', 'request_id': 'req-1b38811a-6f3b-4541-b821-ce570ec8af1e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.177439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 903/1838] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:37 2022] DELETE /identity/v3/users/bd118a4c9a1a46d688ca311bbd2e7828 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:38.185141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.188427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.188427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.230392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:38.234562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:38.256837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] The token cache is being invalidate because project 87b3ba7f91ce48a78ddf619e2b880569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:38.259707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.259707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1b38811a-6f3b-4541-b821-ce570ec8af1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:38.261303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 936/1839] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:37 2022] DELETE /identity/v3/projects/87b3ba7f91ce48a78ddf619e2b880569 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:38.266642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f899-3e33-4448-aca7-191819a69500 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.267195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f899-3e33-4448-aca7-191819a69500 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.267677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f899-3e33-4448-aca7-191819a69500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.325450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9f85f899-3e33-4448-aca7-191819a69500 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:38.329706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9f85f899-3e33-4448-aca7-191819a69500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:38.331351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 904/1840] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:38.351818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:38.356367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 937/1841] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:38.356557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:38.365436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c306-a3df-4a09-acfb-7326970aede5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.371360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c306-a3df-4a09-acfb-7326970aede5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.371360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179c306-a3df-4a09-acfb-7326970aede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.419257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2179c306-a3df-4a09-acfb-7326970aede5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:38.421605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2179c306-a3df-4a09-acfb-7326970aede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:38.439413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 938/1842] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:38.442978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c306-a3df-4a09-acfb-7326970aede5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:38.456366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179c306-a3df-4a09-acfb-7326970aede5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:38.468848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:38.470619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.470898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.471170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.471666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5d09-9ec8-4dba-9e22-848f2d0473ab None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:38.473114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:38.473923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:38.476094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:38.481160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:38.490249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.490921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 939/1843] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:38.491529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.493778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.495754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:38.511179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36439b-c2be-4bfd-bae2-b725d57545ef admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:38.512960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:38.516502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:38.517000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:38.517869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.518152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.518428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.519101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:38.521732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:38.533778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 905/1844] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:38.625011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 940/1845] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:38 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:38.629333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:38.650779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90704c3a-b6a7-4d54-b283-2feafd169d2f service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:38.718029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:38.718688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.718971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.719247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.719904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:38.721937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:38.840092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 906/1846] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:38 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:38:38.855226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:38.882760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591aedb-b627-4387-94c3-4dc7091f5dd7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:38.893245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:38.894354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.895600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.896282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.897237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:38.899256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:38.915479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 941/1847] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:38.921381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:38.934513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05c2a1-a4ea-4275-81b0-b5c69f3dd159 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:38.943321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e02cb-ee7a-4024-94f7-575cb4c70cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:38.946264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e02cb-ee7a-4024-94f7-575cb4c70cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.946264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e02cb-ee7a-4024-94f7-575cb4c70cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.946264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e02cb-ee7a-4024-94f7-575cb4c70cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:38.946264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e02cb-ee7a-4024-94f7-575cb4c70cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:38.948178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e02cb-ee7a-4024-94f7-575cb4c70cf4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:38.965079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 907/1848] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:38.970292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:38.984888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5f523-9fb6-4633-9010-75d19e11c56f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:38.991106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:38.993766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:38.994050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:38.994376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] PATH_INFO: `/v3/projects/388bcf2ff3464102921369275e953556/users/0edbaf4582874d898837ef71a0b77586/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:39.006087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:39.022361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388bcf2ff3464102921369275e953556, user_id=0edbaf4582874d898837ef71a0b77586, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:39.026846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:39.120026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 942/1849] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:38 2022] PUT /identity/v3/projects/388bcf2ff3464102921369275e953556/users/0edbaf4582874d898837ef71a0b77586/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:38:39.124933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:39.125687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:39.125866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:39.163330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] MFA Rules not processed for user `0edbaf4582874d898837ef71a0b77586`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:39.164457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:39.296506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 908/1850] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:39.307814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:39.309844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:39.447098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a180-e950-4fb4-8aae-24eb2fa92d61 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:39.455163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:39.456019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:39.456638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:39.457258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:39.477304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:39.479276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:39.496670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 943/1851] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:39.664789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:39.673629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:39.676542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:39.766885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9a92-79f5-4f41-aaf9-26896ae2564c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:39.774460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:39.778355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:39.778669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:39.779003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] PATH_INFO: `/v3/projects/7ec222764ae542379ce0f25d8adebef1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:39.781582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec222764ae542379ce0f25d8adebef1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:39.783126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:39.983016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec222764ae542379ce0f25d8adebef1', 'request_id': 'req-e6a617fa-f37a-40da-91cf-d3f74690b62c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.115017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec222764ae542379ce0f25d8adebef1', 'request_id': 'req-e6a617fa-f37a-40da-91cf-d3f74690b62c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.121251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec222764ae542379ce0f25d8adebef1', 'request_id': 'req-e6a617fa-f37a-40da-91cf-d3f74690b62c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.132380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] The token cache is being invalidate because project 7ec222764ae542379ce0f25d8adebef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:40.132673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.133399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.134874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 909/1852] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:39 2022] DELETE /identity/v3/projects/7ec222764ae542379ce0f25d8adebef1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:40.139154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:40.149930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156584-eb12-420e-a23b-55e4f66f3e3f service glance] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:40.206519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:40.207147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:40.207420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:40.207691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] PATH_INFO: `/v3/users/fa2c23c356e84cd8bdf5634e58d0d010` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:40.208790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2c23c356e84cd8bdf5634e58d0d010)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:40.210775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:40.436832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2c23c356e84cd8bdf5634e58d0d010'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.443617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2c23c356e84cd8bdf5634e58d0d010'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.509970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2c23c356e84cd8bdf5634e58d0d010'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.524411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2c23c356e84cd8bdf5634e58d0d010'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.525187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-432f0bf6-8fbf-45b0-acc3-e80784e93823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2c23c356e84cd8bdf5634e58d0d010'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:40.531876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 944/1853] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:40 2022] DELETE /identity/v3/users/fa2c23c356e84cd8bdf5634e58d0d010 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:40.742168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:41.059306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:41.061395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:41.076771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a617fa-f37a-40da-91cf-d3f74690b62c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:41.157574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:41.158219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:41.158500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:41.158795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] PATH_INFO: `/v3/projects/3540742581214c82a925d4eb9f2c491b` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:41.161550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3540742581214c82a925d4eb9f2c491b)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:41.163830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:41.313596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3540742581214c82a925d4eb9f2c491b', 'request_id': 'req-a6a674e1-06dc-4015-8d52-ada74f147325'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:41.389473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3540742581214c82a925d4eb9f2c491b', 'request_id': 'req-a6a674e1-06dc-4015-8d52-ada74f147325'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:41.395989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3540742581214c82a925d4eb9f2c491b', 'request_id': 'req-a6a674e1-06dc-4015-8d52-ada74f147325'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:41.409473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] The token cache is being invalidate because project 3540742581214c82a925d4eb9f2c491b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:41.409835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:41.410658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a6a674e1-06dc-4015-8d52-ada74f147325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:41.412569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 910/1854] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:41 2022] DELETE /identity/v3/projects/3540742581214c82a925d4eb9f2c491b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:41.418133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd74f-8797-4a65-b072-7e771c1572cf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:41.420477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd74f-8797-4a65-b072-7e771c1572cf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:41.420477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd74f-8797-4a65-b072-7e771c1572cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:41.443759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7bfbd74f-8797-4a65-b072-7e771c1572cf None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:41.443759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7bfbd74f-8797-4a65-b072-7e771c1572cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:41.509092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 945/1855] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:41.518668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e070ed-3920-4b5a-90b0-488fcbfc5255 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:41.519009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e070ed-3920-4b5a-90b0-488fcbfc5255 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:41.519235 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e070ed-3920-4b5a-90b0-488fcbfc5255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:41.540525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-06e070ed-3920-4b5a-90b0-488fcbfc5255 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:41.541843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-06e070ed-3920-4b5a-90b0-488fcbfc5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:41.554505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 911/1856] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:38:41.557985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbd74f-8797-4a65-b072-7e771c1572cf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:41.567925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbd74f-8797-4a65-b072-7e771c1572cf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:41.572637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:41.573273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:41.573918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:41.573918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:41.574570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:41.575227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:41.576915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:41.589495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 946/1857] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:41.594972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e070ed-3920-4b5a-90b0-488fcbfc5255 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:41.604805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e070ed-3920-4b5a-90b0-488fcbfc5255 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:41.611204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:41.619145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:41.619145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:41.619145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:41.619145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:41.619145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:41.717738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 912/1858] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:41 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:41.718845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:41.730586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52a97-ca43-4d26-bc2b-f903d0113bcf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:41.814805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:41.817787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:41.817787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:41.817787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:41.817787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:41.819102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:42.005576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 947/1859] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:41 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:38:42.012966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:42.024664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc47d42-ac67-4abf-85df-847efcfa5573 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:42.030996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:42.031778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:42.032148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:42.032696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:42.033843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:42.035874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:42.053267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 913/1860] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:42.054889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:42.068157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dada7-b382-445f-94ff-fb152c0d6245 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:42.073530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fa66f-c6cd-48fc-8560-16a1526543c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:42.074152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa66f-c6cd-48fc-8560-16a1526543c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:42.074493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa66f-c6cd-48fc-8560-16a1526543c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:42.074786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa66f-c6cd-48fc-8560-16a1526543c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:42.075478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fa66f-c6cd-48fc-8560-16a1526543c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:42.077834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fa66f-c6cd-48fc-8560-16a1526543c4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:42.091695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 948/1861] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:38:42.095867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:42.108885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6122f0-edaf-4532-8a9f-137564ffa01d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:42.114246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:42.114980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:42.115258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:42.115527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] PATH_INFO: `/v3/projects/5513f71ffc9441f3802273acb69fba3b/users/8f64d7d59a1d4736bc89abbb31508d46/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:42.134571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5513f71ffc9441f3802273acb69fba3b, user_id=8f64d7d59a1d4736bc89abbb31508d46, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:42.137260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:42.456449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 914/1862] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:38:42 2022] PUT /identity/v3/projects/5513f71ffc9441f3802273acb69fba3b/users/8f64d7d59a1d4736bc89abbb31508d46/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:42.461530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1505062-c6c3-4b43-a1f7-782edc68b345 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:42.462024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1505062-c6c3-4b43-a1f7-782edc68b345 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:42.462115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1505062-c6c3-4b43-a1f7-782edc68b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:42.494316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a1505062-c6c3-4b43-a1f7-782edc68b345 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:42.495551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a1505062-c6c3-4b43-a1f7-782edc68b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:42.568632 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 949/1863] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:42.578781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:42.583364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:42.645312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c4e61-983c-40a2-bd82-9747bdd4b1db admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:42.648912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0bc82-5e92-458b-a341-95cdd856737c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:42.649558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0bc82-5e92-458b-a341-95cdd856737c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:42.649835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0bc82-5e92-458b-a341-95cdd856737c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:42.650111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0bc82-5e92-458b-a341-95cdd856737c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:42.660324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0bc82-5e92-458b-a341-95cdd856737c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:42.663722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0bc82-5e92-458b-a341-95cdd856737c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:42.672069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 915/1864] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:38:42.868005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:43.802543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:44.400725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9e5d-a6ff-4e3c-a753-489ead2ddf05 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:44.401024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9e5d-a6ff-4e3c-a753-489ead2ddf05 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:44.401427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9e5d-a6ff-4e3c-a753-489ead2ddf05 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:44.403103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 950/1865] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:38:44.420444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:44.421088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:44.421672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:44.442906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:44.444121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:44.542575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 916/1866] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:44.736210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:44.736606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:44.737070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:44.775456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] MFA Rules not processed for user `8f64d7d59a1d4736bc89abbb31508d46`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:44.777001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:44.848019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:44.849921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:44.879155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81370-d326-45d0-9470-84a678519e22 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:44.890590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419010d-edff-4208-80f0-f60cef0e4f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:44.891221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419010d-edff-4208-80f0-f60cef0e4f7e service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:44.892206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419010d-edff-4208-80f0-f60cef0e4f7e service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:44.892206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419010d-edff-4208-80f0-f60cef0e4f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:44.897923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 951/1867] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:44.901294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:44.914447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419010d-edff-4208-80f0-f60cef0e4f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:44.914447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419010d-edff-4208-80f0-f60cef0e4f7e service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:44.914735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:44.914735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:44.925932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 917/1868] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:38:44.988957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:45.042724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d17ec-2bd4-4913-b1e6-45f08a7d1fa6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:45.053202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:45.054458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:45.054748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:45.056211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:45.071770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:45.073329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:45.088727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 952/1869] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:38:45.704603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:46.366655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:47.065272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8044df-2637-4676-b150-20d5a7e9f562 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:47.065552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8044df-2637-4676-b150-20d5a7e9f562 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:47.065831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8044df-2637-4676-b150-20d5a7e9f562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:47.089002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3b8044df-2637-4676-b150-20d5a7e9f562 None None] MFA Rules not processed for user `8f64d7d59a1d4736bc89abbb31508d46`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:47.090312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3b8044df-2637-4676-b150-20d5a7e9f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:47.098136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 918/1870] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:47.772731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:47.887187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:48.939533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:49.035264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:50.366764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:51.866021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:57.534740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:57.536586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:57.551906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c73f-4a4b-4096-baae-b793a0e0da57 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:57.557316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:57.558154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:57.558525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:57.558698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] PATH_INFO: `/v3/users/0edbaf4582874d898837ef71a0b77586` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:57.560693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edbaf4582874d898837ef71a0b77586)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:57.562638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:57.749340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:57.752684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edbaf4582874d898837ef71a0b77586'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:57.760310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edbaf4582874d898837ef71a0b77586'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:57.848749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edbaf4582874d898837ef71a0b77586'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:57.863224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edbaf4582874d898837ef71a0b77586'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:57.863957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edbaf4582874d898837ef71a0b77586'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:57.870655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 953/1871] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:38:57 2022] DELETE /identity/v3/users/0edbaf4582874d898837ef71a0b77586 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:57.875718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:57.876210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:57.876391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:57.895928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:57.897327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:57.981393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 919/1872] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:58.014865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:58.016975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:58.089753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4d65c-4604-4ebe-bbf3-9d0b0cd48242 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:58.094085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28a2a-f17e-4bf6-91df-e7f17558f4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:58.094806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28a2a-f17e-4bf6-91df-e7f17558f4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:58.095153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28a2a-f17e-4bf6-91df-e7f17558f4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:58.095491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28a2a-f17e-4bf6-91df-e7f17558f4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:58.106287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28a2a-f17e-4bf6-91df-e7f17558f4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:58.107847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28a2a-f17e-4bf6-91df-e7f17558f4dc service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:58.120577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 954/1873] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:38:58.947845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:58.949694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:58.963351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b1b7-c13d-4df6-bd23-10f77f7a7e3a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:58.971314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:58.972212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:58.972639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:58.973115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] PATH_INFO: `/v3/projects/388bcf2ff3464102921369275e953556` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:58.986073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] RBAC: Authorizing `identity:delete_project(project_id=388bcf2ff3464102921369275e953556)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:58.992306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:59.211360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388bcf2ff3464102921369275e953556', 'request_id': 'req-de634de8-5022-4d91-927d-4da8e2eb384d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:59.286365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388bcf2ff3464102921369275e953556', 'request_id': 'req-de634de8-5022-4d91-927d-4da8e2eb384d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:59.294009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388bcf2ff3464102921369275e953556', 'request_id': 'req-de634de8-5022-4d91-927d-4da8e2eb384d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:59.306992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] The token cache is being invalidate because project 388bcf2ff3464102921369275e953556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:38:59.307512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:59.308333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-de634de8-5022-4d91-927d-4da8e2eb384d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:38:59.311339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 920/1874] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:38:58 2022] DELETE /identity/v3/projects/388bcf2ff3464102921369275e953556 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:38:59.317182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11929c59-fa5e-4176-9421-4226730f31b9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:59.318121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11929c59-fa5e-4176-9421-4226730f31b9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:59.318476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11929c59-fa5e-4176-9421-4226730f31b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:59.341813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-11929c59-fa5e-4176-9421-4226730f31b9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:59.343211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-11929c59-fa5e-4176-9421-4226730f31b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:59.443899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 955/1875] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:59.453247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ce15-79ad-434e-9614-5578bf998f6f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:59.453557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ce15-79ad-434e-9614-5578bf998f6f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:59.454379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ce15-79ad-434e-9614-5578bf998f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:59.481811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3390ce15-79ad-434e-9614-5578bf998f6f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:38:59.484371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3390ce15-79ad-434e-9614-5578bf998f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:38:59.494866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 921/1876] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:38:59.498914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11929c59-fa5e-4176-9421-4226730f31b9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:59.510756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11929c59-fa5e-4176-9421-4226730f31b9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:59.517993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:59.519512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:59.519973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:59.520747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:59.521718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:38:59.522007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:59.523604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:59.548864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 956/1877] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:38:59.550335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390ce15-79ad-434e-9614-5578bf998f6f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:59.555760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:59.562965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390ce15-79ad-434e-9614-5578bf998f6f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:59.569634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:59.570548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:59.571004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:59.571474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:59.572959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:59.576015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:59.717289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 922/1878] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:38:59 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:59.721412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:38:59.733837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927d4c6-5866-498e-8ff2-26aaf598e607 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:38:59.836632 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:59.853765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:38:59.854585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:38:59.854945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:38:59.855377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:38:59.857115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:38:59.859650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:38:59.984664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 957/1879] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:38:59 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:38:59.988967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.007254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b9d4-f52c-444f-a379-0fe2c39bf5cc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.035731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.037852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.040494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.040950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.042291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.046411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.066951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 923/1880] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:00.071250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.091514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e7bb4-a3e7-4ec2-b661-e073d2e52eae admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.099002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e5d74-4b9e-4a27-8fa2-695857d9f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.099773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e5d74-4b9e-4a27-8fa2-695857d9f613 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.100056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e5d74-4b9e-4a27-8fa2-695857d9f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.100338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e5d74-4b9e-4a27-8fa2-695857d9f613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.100992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e5d74-4b9e-4a27-8fa2-695857d9f613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.102717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e5d74-4b9e-4a27-8fa2-695857d9f613 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.117468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 958/1881] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:00.119154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.131529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccb6b-cdaf-47a4-bdb6-0dc172386afe admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.138589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.139538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.139949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.140403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] PATH_INFO: `/v3/projects/a8eb16f95ab24e5bb4223a50e7366888/users/cc401ca9e45c42ee918b8e77a68608f1/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.158120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8eb16f95ab24e5bb4223a50e7366888, user_id=cc401ca9e45c42ee918b8e77a68608f1, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.161961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.237352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 924/1882] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:00 2022] PUT /identity/v3/projects/a8eb16f95ab24e5bb4223a50e7366888/users/cc401ca9e45c42ee918b8e77a68608f1/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:00.245571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43acf5-cf3a-4618-8103-fa47b6b4c54f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.245858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43acf5-cf3a-4618-8103-fa47b6b4c54f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.246305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43acf5-cf3a-4618-8103-fa47b6b4c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.275970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0d43acf5-cf3a-4618-8103-fa47b6b4c54f None None] MFA Rules not processed for user `cc401ca9e45c42ee918b8e77a68608f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:00.277453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0d43acf5-cf3a-4618-8103-fa47b6b4c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:00.344981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 959/1883] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:00.349619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.411641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eefc9-2b24-4b3d-8e96-0d48a32d218b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.416343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.416945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.417263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.417537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.418166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.420501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.533819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 925/1884] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:00 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:00.537718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43acf5-cf3a-4618-8103-fa47b6b4c54f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.549568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43acf5-cf3a-4618-8103-fa47b6b4c54f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.610553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.611232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.611515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.611784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.612506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.614731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.752190 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 960/1885] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:00 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:00.756063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.769017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98abe9-db7d-41ca-9853-ceb8cf65fccd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.775789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.776899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.777169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.777517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.778350 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.780137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.794629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 926/1886] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:39:00.799498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.811333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55896f11-8458-4bb6-8f50-ddc43eb5f97e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.816035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8f061-6d49-4bda-b4b4-57ea63234654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.816649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f061-6d49-4bda-b4b4-57ea63234654 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.816958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f061-6d49-4bda-b4b4-57ea63234654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.817869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f061-6d49-4bda-b4b4-57ea63234654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.819333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8f061-6d49-4bda-b4b4-57ea63234654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.820931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8f061-6d49-4bda-b4b4-57ea63234654 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.833264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 961/1887] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:00.837221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:00.848394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05543-05d2-4e84-8bc4-59c704d83818 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:00.854699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:00.855420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.857001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.857001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] PATH_INFO: `/v3/projects/4ceed43ad90a45c09e50bfd4edff528b/users/c52f6c247fb140baa929ed4c9ac3cd4e/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.874483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ceed43ad90a45c09e50bfd4edff528b, user_id=c52f6c247fb140baa929ed4c9ac3cd4e, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:00.877550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:00.946313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 927/1888] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:00 2022] PUT /identity/v3/projects/4ceed43ad90a45c09e50bfd4edff528b/users/c52f6c247fb140baa929ed4c9ac3cd4e/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:00.958898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95934d2-ae2a-4c65-a67b-169941db1089 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:00.959186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95934d2-ae2a-4c65-a67b-169941db1089 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:00.959461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95934d2-ae2a-4c65-a67b-169941db1089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:00.988561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e95934d2-ae2a-4c65-a67b-169941db1089 None None] MFA Rules not processed for user `c52f6c247fb140baa929ed4c9ac3cd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:00.989857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e95934d2-ae2a-4c65-a67b-169941db1089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:01.057433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 962/1889] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:01.062242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:01.125607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:01.130635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209ee7c-80cb-44a7-9e1f-812fe2c4ec8a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:01.135300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:01.135941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:01.136222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:01.136493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:01.137234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:01.139237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:01.338589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 928/1890] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:01 2022] POST /identity/v3/projects => generated 383 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:01.342078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95934d2-ae2a-4c65-a67b-169941db1089 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:01.355420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95934d2-ae2a-4c65-a67b-169941db1089 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:01.424485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:01.425331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:01.425600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:01.425954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:01.426690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:01.429000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:01.552599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 963/1891] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:01 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:01.556422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:01.567430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6811776-d16b-42ad-8dd4-93edaed17c63 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:01.572333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:01.572990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:01.573333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:01.573574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:01.574232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:01.576405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:01.587973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 929/1892] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:01.592393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:01.604267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ae55-bea5-4811-9ff5-dae4c9e77fdb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:01.607184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:01.613676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:01.614437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:01.614789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:01.615124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] PATH_INFO: `/v3/projects/c9fedfa731794cef809a1f88a451296a/users/90afd99ffa104119a0f81fd9a4fae99c/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:01.632805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9fedfa731794cef809a1f88a451296a, user_id=90afd99ffa104119a0f81fd9a4fae99c, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:01.635640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:01.743830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 964/1893] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:01 2022] PUT /identity/v3/projects/c9fedfa731794cef809a1f88a451296a/users/90afd99ffa104119a0f81fd9a4fae99c/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:01.747693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:01.757845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9fc4-10b7-404d-8b2c-be1fa8f246f5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:01.835869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122d68-08ca-45ab-a21d-047c2ba4fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:01.836497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122d68-08ca-45ab-a21d-047c2ba4fc09 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:01.836785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122d68-08ca-45ab-a21d-047c2ba4fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:01.837126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122d68-08ca-45ab-a21d-047c2ba4fc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:01.837724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122d68-08ca-45ab-a21d-047c2ba4fc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:01.839577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122d68-08ca-45ab-a21d-047c2ba4fc09 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:01.856736 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 930/1894] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:01.856898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:01.867355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6dc30-1263-48c2-b143-8e5d73e71e65 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:01.872905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:01.873652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:01.873930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:01.874204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] PATH_INFO: `/v3/projects/c9fedfa731794cef809a1f88a451296a/users/90afd99ffa104119a0f81fd9a4fae99c/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:01.876120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9fedfa731794cef809a1f88a451296a, user_id=90afd99ffa104119a0f81fd9a4fae99c, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:01.878787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:01.890198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 965/1895] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:01 2022] PUT /identity/v3/projects/c9fedfa731794cef809a1f88a451296a/users/90afd99ffa104119a0f81fd9a4fae99c/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:01.900432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf783cb-226c-4119-8356-d31997775c04 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:01.901012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf783cb-226c-4119-8356-d31997775c04 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:01.901462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf783cb-226c-4119-8356-d31997775c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:01.937492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-cbf783cb-226c-4119-8356-d31997775c04 None None] MFA Rules not processed for user `90afd99ffa104119a0f81fd9a4fae99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:01.938633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cbf783cb-226c-4119-8356-d31997775c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:02.042916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 931/1896] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:02.057513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:02.059341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:02.127646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae59488-d5d0-4ef9-9475-3c6beffd117a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:02.131332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:02.131962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:02.132242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:02.132535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:02.191268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:02.192738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:02.203042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 966/1897] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:02.769437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:04.213771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf783cb-226c-4119-8356-d31997775c04 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:04.223909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf783cb-226c-4119-8356-d31997775c04 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:04.227460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:04.228053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:04.228331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:04.228601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:04.280804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:04.294532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:04.295979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:04.306550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 932/1898] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:05.958466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:05.968602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54655b9-a2f1-4c33-8c98-16023b9594da service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:05.972357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:05.972986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:05.973357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:05.973608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:05.983439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:05.984896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:05.995095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 967/1899] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:10.822697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:10.824083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:10.904015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d2488-aadb-4fe4-85e8-4deaa1fcfd3b service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:10.908153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:10.909979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:10.910877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:10.911156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:10.911456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] PATH_INFO: `/v3/users/d37f58255fc040c29740f8ca45d28037` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:10.912657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37f58255fc040c29740f8ca45d28037)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:10.915498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:10.918553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2af8-f328-46fc-bc00-658c833fc6a0 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:10.924152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:10.924777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:10.929097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:10.929097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] PATH_INFO: `/v3/users/cc401ca9e45c42ee918b8e77a68608f1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:10.929097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc401ca9e45c42ee918b8e77a68608f1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:10.929097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:11.195650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc401ca9e45c42ee918b8e77a68608f1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.198292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37f58255fc040c29740f8ca45d28037'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.198959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37f58255fc040c29740f8ca45d28037'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.203344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc401ca9e45c42ee918b8e77a68608f1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.207101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37f58255fc040c29740f8ca45d28037'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.219817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37f58255fc040c29740f8ca45d28037'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.220532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-36d26f64-bbd6-44c6-a971-103d87d32174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37f58255fc040c29740f8ca45d28037'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.276853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc401ca9e45c42ee918b8e77a68608f1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.293009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc401ca9e45c42ee918b8e77a68608f1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.293815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4105bb73-0fb8-4af8-9d03-ddb6a80b13b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc401ca9e45c42ee918b8e77a68608f1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:11.300589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 968/1900] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:10 2022] DELETE /identity/v3/users/cc401ca9e45c42ee918b8e77a68608f1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:11.304927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:11.305262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:11.305539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:11.326590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:11.327869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:11.346624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 933/1901] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:10 2022] DELETE /identity/v3/users/d37f58255fc040c29740f8ca45d28037 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:11.350879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:11.351171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:11.351471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:11.372446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:11.373664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:11.390049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 969/1902] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:11.400398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:11.401825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:11.436286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 934/1903] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:11.437967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:11.446144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:11.451997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:11.460994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:11.461326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5f54-a161-4ffd-a7db-8a2b47e19275 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:11.518485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:11.518737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26510d14-2d64-436f-9d7c-79f8cf470d5d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:11.519339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:11.519693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:11.520033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:11.522547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:11.523185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:11.523536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:11.523878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:11.535138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:11.537012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:11.538942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:11.541439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:11.549352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 970/1904] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:39:11.555217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 935/1905] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:39:12.130464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:12.132034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:12.150433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b2955-293c-463a-97d2-d83ce714ce16 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:12.156036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:12.161948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:12.161948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:12.161948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] PATH_INFO: `/v3/projects/4a9c49b6320a404289e5bcee1f163212` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:12.161948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9c49b6320a404289e5bcee1f163212)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:12.161948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:12.208174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:12.208174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:12.214682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c4fe2-a35f-4a24-a613-9169531a1a0e service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:12.219635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:12.220271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:12.220747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:12.221223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] PATH_INFO: `/v3/projects/a8eb16f95ab24e5bb4223a50e7366888` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:12.222502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8eb16f95ab24e5bb4223a50e7366888)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:12.224760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:12.280498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9c49b6320a404289e5bcee1f163212', 'request_id': 'req-dc854206-9985-4e29-8cb7-4f0b823828ae'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.286493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9c49b6320a404289e5bcee1f163212', 'request_id': 'req-dc854206-9985-4e29-8cb7-4f0b823828ae'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.292640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9c49b6320a404289e5bcee1f163212', 'request_id': 'req-dc854206-9985-4e29-8cb7-4f0b823828ae'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.391625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8eb16f95ab24e5bb4223a50e7366888', 'request_id': 'req-e2a93301-758e-498f-88a0-712098419998'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.452002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] The token cache is being invalidate because project 4a9c49b6320a404289e5bcee1f163212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:12.452554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.453421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.458159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 971/1906] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:12 2022] DELETE /identity/v3/projects/4a9c49b6320a404289e5bcee1f163212 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:12.463276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:12.463276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:12.537750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854206-9985-4e29-8cb7-4f0b823828ae admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:12.557489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:12.568281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8eb16f95ab24e5bb4223a50e7366888', 'request_id': 'req-e2a93301-758e-498f-88a0-712098419998'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.575617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8eb16f95ab24e5bb4223a50e7366888', 'request_id': 'req-e2a93301-758e-498f-88a0-712098419998'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.587595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] The token cache is being invalidate because project a8eb16f95ab24e5bb4223a50e7366888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:12.587800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.588448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.593508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 936/1907] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:12 2022] DELETE /identity/v3/projects/a8eb16f95ab24e5bb4223a50e7366888 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:12.594644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:12.596035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:12.604851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:12.605539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:12.605810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:12.606628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] PATH_INFO: `/v3/users/8e1a599cc46644a5a684cb6776f47cce` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:12.607798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1a599cc46644a5a684cb6776f47cce)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:12.611110 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:12.669403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a93301-758e-498f-88a0-712098419998 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:12.674415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:12.675077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:12.675358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:12.675633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] PATH_INFO: `/v3/users/c52f6c247fb140baa929ed4c9ac3cd4e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:12.676829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52f6c247fb140baa929ed4c9ac3cd4e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:12.678908 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:12.842678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1a599cc46644a5a684cb6776f47cce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:12.870030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1a599cc46644a5a684cb6776f47cce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.113608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1a599cc46644a5a684cb6776f47cce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.127784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1a599cc46644a5a684cb6776f47cce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.128749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1a599cc46644a5a684cb6776f47cce'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.134759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 972/1908] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:12 2022] DELETE /identity/v3/users/8e1a599cc46644a5a684cb6776f47cce => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:13.312638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:13.321555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52f6c247fb140baa929ed4c9ac3cd4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.322232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52f6c247fb140baa929ed4c9ac3cd4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.336702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52f6c247fb140baa929ed4c9ac3cd4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.354043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52f6c247fb140baa929ed4c9ac3cd4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.354787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52f6c247fb140baa929ed4c9ac3cd4e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:13.441496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 937/1909] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:12 2022] DELETE /identity/v3/users/c52f6c247fb140baa929ed4c9ac3cd4e => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:13.941243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:13.941243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:14.051706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bb730-6aac-4fc8-9bcf-f0eef8ffe28f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:14.125189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:14.140584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:14.141289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.142118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.142571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] PATH_INFO: `/v3/projects/ca456c38c0f64eb8b8e15251302ac807` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.144426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca456c38c0f64eb8b8e15251302ac807)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:14.147255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:14.271008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:14.277102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:14.304000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1b684-983c-4897-a432-d9c2145762ac admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:14.330095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca456c38c0f64eb8b8e15251302ac807', 'request_id': 'req-b19755a4-612f-4c68-937e-12188a7d936e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.338537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca456c38c0f64eb8b8e15251302ac807', 'request_id': 'req-b19755a4-612f-4c68-937e-12188a7d936e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.347382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca456c38c0f64eb8b8e15251302ac807', 'request_id': 'req-b19755a4-612f-4c68-937e-12188a7d936e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.382049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:14.383075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.383516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.383890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] PATH_INFO: `/v3/projects/4ceed43ad90a45c09e50bfd4edff528b` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.385336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ceed43ad90a45c09e50bfd4edff528b)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:14.388200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:14.482760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] The token cache is being invalidate because project ca456c38c0f64eb8b8e15251302ac807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:14.483055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.483696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b19755a4-612f-4c68-937e-12188a7d936e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.489290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 973/1910] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:13 2022] DELETE /identity/v3/projects/ca456c38c0f64eb8b8e15251302ac807 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:14.490662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277cf0b-9c4a-4063-83e7-aa246d9ec608 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.490958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277cf0b-9c4a-4063-83e7-aa246d9ec608 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.491233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277cf0b-9c4a-4063-83e7-aa246d9ec608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.534414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9277cf0b-9c4a-4063-83e7-aa246d9ec608 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:14.535596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9277cf0b-9c4a-4063-83e7-aa246d9ec608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:14.545725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ceed43ad90a45c09e50bfd4edff528b', 'request_id': 'req-32575332-7435-4fb6-a88f-95e3a9f53bc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.626874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 974/1911] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:14.634539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268d69-de60-4fe7-9c59-d5e4e122ea06 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.634830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268d69-de60-4fe7-9c59-d5e4e122ea06 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.635108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268d69-de60-4fe7-9c59-d5e4e122ea06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.655209 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ceed43ad90a45c09e50bfd4edff528b', 'request_id': 'req-32575332-7435-4fb6-a88f-95e3a9f53bc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.655405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cf268d69-de60-4fe7-9c59-d5e4e122ea06 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:14.656598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cf268d69-de60-4fe7-9c59-d5e4e122ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:14.665784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ceed43ad90a45c09e50bfd4edff528b', 'request_id': 'req-32575332-7435-4fb6-a88f-95e3a9f53bc0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.669409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 975/1912] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:14.670301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268d69-de60-4fe7-9c59-d5e4e122ea06 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:14.680092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268d69-de60-4fe7-9c59-d5e4e122ea06 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:14.686548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:14.691784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.691784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.691784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.691784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:14.691784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:14.692175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] The token cache is being invalidate because project 4ceed43ad90a45c09e50bfd4edff528b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:14.692175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.692355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:14.692433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.699056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 938/1913] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:14 2022] DELETE /identity/v3/projects/4ceed43ad90a45c09e50bfd4edff528b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:14.702463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:14.704231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:14.714022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 976/1914] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:39:14.716219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:14.717920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:14.721846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32575332-7435-4fb6-a88f-95e3a9f53bc0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:14.725804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:14.726592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.726774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.727098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] PATH_INFO: `/v3/users/90afd99ffa104119a0f81fd9a4fae99c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.728846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90afd99ffa104119a0f81fd9a4fae99c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:14.730825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:14.736579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f813e3-9efc-455c-ad5f-476b47e00c84 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:14.753335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:14.754085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.754582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.754957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.758841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:14.766145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:14.901495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 977/1915] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:14 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:14.902614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:14.973400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091421-97e6-4878-a614-04ed8747b4bc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:14.985733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:14.986521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:14.986791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:14.987069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:14.988147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:14.988752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:14.991664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:14.995544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90afd99ffa104119a0f81fd9a4fae99c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:14.996213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90afd99ffa104119a0f81fd9a4fae99c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:15.004564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90afd99ffa104119a0f81fd9a4fae99c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:15.017272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90afd99ffa104119a0f81fd9a4fae99c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:15.018018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90afd99ffa104119a0f81fd9a4fae99c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:15.115167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 939/1916] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:14 2022] DELETE /identity/v3/users/90afd99ffa104119a0f81fd9a4fae99c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:15.123515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 978/1917] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:14 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:15.123693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:15.123693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:15.239953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77123-1345-46f0-801f-f90cc3b02e48 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:15.244917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:15.245129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:15.245562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:15.245859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:15.248314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:15.248613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:15.249638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:15.260970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 940/1918] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:15.265269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:15.275609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137897-fc52-4b9b-86da-74940445a485 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:15.280927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18541d-2cd4-4684-8382-a1efa038332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:15.281694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18541d-2cd4-4684-8382-a1efa038332a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:15.282039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18541d-2cd4-4684-8382-a1efa038332a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:15.282629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18541d-2cd4-4684-8382-a1efa038332a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:15.283275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18541d-2cd4-4684-8382-a1efa038332a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:15.284866 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18541d-2cd4-4684-8382-a1efa038332a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:15.296597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 979/1919] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:39:15.301144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:15.321462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16473706-58b3-487e-b44e-3c7a5f3f829f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:15.325713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:15.326662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:15.327010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:15.327540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] PATH_INFO: `/v3/projects/a4d3583b4521488894a2c25b431dfbad/users/a509435ae8e94d0a9c207454df2a23d6/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:15.344415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d3583b4521488894a2c25b431dfbad, user_id=a509435ae8e94d0a9c207454df2a23d6, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:15.355185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:15.496673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 941/1920] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:15 2022] PUT /identity/v3/projects/a4d3583b4521488894a2c25b431dfbad/users/a509435ae8e94d0a9c207454df2a23d6/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:15.498453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:15.499508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:15.499792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:15.578424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] MFA Rules not processed for user `a509435ae8e94d0a9c207454df2a23d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:15.581745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:15.656164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 980/1921] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:15.661279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:15.696644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:15.698230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:15.740356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01187f6d-0233-42f8-b602-220de57bb491 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:15.747105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9d001-8fdd-4ff1-956a-1378fddfb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:15.747556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d001-8fdd-4ff1-956a-1378fddfb334 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:15.748101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d001-8fdd-4ff1-956a-1378fddfb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:15.748771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d001-8fdd-4ff1-956a-1378fddfb334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:15.763236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9d001-8fdd-4ff1-956a-1378fddfb334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:15.768355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9d001-8fdd-4ff1-956a-1378fddfb334 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:15.793596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b943d0-7665-47dd-8182-07abe5c20019 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:15.799283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:15.800340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:15.801061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:15.801576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] PATH_INFO: `/v3/projects/c9fedfa731794cef809a1f88a451296a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:15.803619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9fedfa731794cef809a1f88a451296a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:15.805716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:15.931271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 942/1922] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:15 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:15.932666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fbf00-0f40-463d-94e7-b260d3d9d320 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:15.932971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fbf00-0f40-463d-94e7-b260d3d9d320 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:15.933302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fbf00-0f40-463d-94e7-b260d3d9d320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:15.962358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-594fbf00-0f40-463d-94e7-b260d3d9d320 None None] MFA Rules not processed for user `8f64d7d59a1d4736bc89abbb31508d46`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:15.963675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-594fbf00-0f40-463d-94e7-b260d3d9d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:15.972250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9fedfa731794cef809a1f88a451296a', 'request_id': 'req-bb5fe738-7568-4657-a315-7795a18609ed'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:15.980659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9fedfa731794cef809a1f88a451296a', 'request_id': 'req-bb5fe738-7568-4657-a315-7795a18609ed'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:16.002131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9fedfa731794cef809a1f88a451296a', 'request_id': 'req-bb5fe738-7568-4657-a315-7795a18609ed'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:16.049661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 943/1923] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:16.049661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fbf00-0f40-463d-94e7-b260d3d9d320 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.101328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] The token cache is being invalidate because project c9fedfa731794cef809a1f88a451296a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:16.101882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:16.102838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-bb5fe738-7568-4657-a315-7795a18609ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:16.105442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 981/1924] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:15 2022] DELETE /identity/v3/projects/c9fedfa731794cef809a1f88a451296a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:16.111759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33093f-68c7-47bd-91fd-6d93075fb622 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.112093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33093f-68c7-47bd-91fd-6d93075fb622 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.112503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33093f-68c7-47bd-91fd-6d93075fb622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.157451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fbf00-0f40-463d-94e7-b260d3d9d320 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.160744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8c33093f-68c7-47bd-91fd-6d93075fb622 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:16.162531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c33093f-68c7-47bd-91fd-6d93075fb622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:16.164223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.164853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.165166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.165441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.166081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.168415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.176230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 982/1925] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:16.183990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71b82-09bc-4554-846a-c86e28271380 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.184489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71b82-09bc-4554-846a-c86e28271380 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.184766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71b82-09bc-4554-846a-c86e28271380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.205248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a0e71b82-09bc-4554-846a-c86e28271380 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:16.206379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a0e71b82-09bc-4554-846a-c86e28271380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:16.217101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 983/1926] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:16.219766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71b82-09bc-4554-846a-c86e28271380 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.230646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71b82-09bc-4554-846a-c86e28271380 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.238140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.238915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.239447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.239786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.240520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:16.240888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.242615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.255997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 984/1927] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:39:16.260621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.272415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f772146-0601-499b-b340-e285d7ca469b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.278460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.279269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.279622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.279898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.280545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.282520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.295306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 944/1928] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:16 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:16.299155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.302496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:16.317299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6aeef-6c05-4550-a413-c0d4ab0178ab admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.322616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.323557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.324155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.324643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.325691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.327494 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.346724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 945/1929] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:39:16.350016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.367685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d058bc-2adb-45e9-be3f-6e00919bb7ce admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.381852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.382679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.382966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.383237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] PATH_INFO: `/v3/projects/9045ecedd2c04f7cbe253336fe71c88e/users/64ad61eccfb0475d9ee7d883cec69818/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.424147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9045ecedd2c04f7cbe253336fe71c88e, user_id=64ad61eccfb0475d9ee7d883cec69818, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.426221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 985/1930] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:16 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:16.428027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.430849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.541472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943d678-99e7-44a1-9e00-a435e8858c20 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.548700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 946/1931] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:16 2022] PUT /identity/v3/projects/9045ecedd2c04f7cbe253336fe71c88e/users/64ad61eccfb0475d9ee7d883cec69818/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:16.554679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.576593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:16.605592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:16.628183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535662-02e3-4be8-a781-43250bbebde6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.629371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.629998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.630314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.630603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.631225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.633492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.634146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.634861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.635251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.635618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.636363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.638300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.649487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 947/1932] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:39:16.654371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.665291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf2630-964b-401b-bba9-06903fe74f8e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.670788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132325ec-5959-4c30-b634-8e570fe13068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.671460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132325ec-5959-4c30-b634-8e570fe13068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.671737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132325ec-5959-4c30-b634-8e570fe13068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.672064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132325ec-5959-4c30-b634-8e570fe13068 admin admin] PATH_INFO: `/v3/projects/9045ecedd2c04f7cbe253336fe71c88e/users/64ad61eccfb0475d9ee7d883cec69818/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.674068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132325ec-5959-4c30-b634-8e570fe13068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9045ecedd2c04f7cbe253336fe71c88e, user_id=64ad61eccfb0475d9ee7d883cec69818, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.676734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132325ec-5959-4c30-b634-8e570fe13068 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.689110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 948/1933] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:16 2022] PUT /identity/v3/projects/9045ecedd2c04f7cbe253336fe71c88e/users/64ad61eccfb0475d9ee7d883cec69818/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:16.700341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.700697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.701079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.729702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 986/1934] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:16 2022] POST /identity/v3/users => generated 292 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:16.730790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.733569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] MFA Rules not processed for user `64ad61eccfb0475d9ee7d883cec69818`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:16.734866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:16.744459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c8c3-5232-4449-accf-1fe3eefb366d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.819923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 949/1935] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:16.832919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c64ee-b929-4225-8951-f2f0b6652f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.834171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c64ee-b929-4225-8951-f2f0b6652f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.834454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c64ee-b929-4225-8951-f2f0b6652f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.834728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c64ee-b929-4225-8951-f2f0b6652f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.835748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c64ee-b929-4225-8951-f2f0b6652f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.836975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.837577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c64ee-b929-4225-8951-f2f0b6652f8f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.838629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:16.863088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 987/1936] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:16.864880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bea01e-da1e-4396-9528-2aa5787b97ef None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.865199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bea01e-da1e-4396-9528-2aa5787b97ef None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.865483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bea01e-da1e-4396-9528-2aa5787b97ef None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.869861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 988/1937] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:39:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:39:16.871529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bea01e-da1e-4396-9528-2aa5787b97ef None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:16.887412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bea01e-da1e-4396-9528-2aa5787b97ef None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.895403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c251d3-d9ad-43e4-b169-3df6e06902f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.896348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c251d3-d9ad-43e4-b169-3df6e06902f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.897471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c251d3-d9ad-43e4-b169-3df6e06902f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.899274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c251d3-d9ad-43e4-b169-3df6e06902f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.899274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c251d3-d9ad-43e4-b169-3df6e06902f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.901420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c251d3-d9ad-43e4-b169-3df6e06902f7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.917495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 989/1938] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:16.919740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.919953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.920204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.937279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e063-7ce0-4c52-bb41-28d04e68b144 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:16.942166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:16.943033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:16.943493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:16.943963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:16.949186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:16.950828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:16.970910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:16.973654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:16.987277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 950/1939] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:16.999490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:17.015342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd6af-d131-4e0c-a33d-cfeea5a1d799 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:17.022379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:17.023510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:17.026348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:17.026864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] PATH_INFO: `/v3/projects/d4b054624cc4432fbed995dce074e139/users/fc1418800d0b4cf2b21ce9556f92e20e/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:17.047991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 990/1940] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:17.048216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b054624cc4432fbed995dce074e139, user_id=fc1418800d0b4cf2b21ce9556f92e20e, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:17.048960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:17.050247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:17.051398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:17.064406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc834-6f47-4dab-af91-d6af369095f1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:17.068934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:17.069582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:17.069854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:17.070120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] PATH_INFO: `/v3/users/c3713a10f2cb4a6c81a4ca06d6f9a60d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:17.071288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3713a10f2cb4a6c81a4ca06d6f9a60d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:17.073199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:17.077112 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:17.155158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 951/1941] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:16 2022] PUT /identity/v3/projects/d4b054624cc4432fbed995dce074e139/users/fc1418800d0b4cf2b21ce9556f92e20e/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:17.156189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:17.163110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:17.202427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:17.276684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9a99-6eea-4bd6-9a3c-53e4cce6e303 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:17.282811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397b898-df89-4d31-94ac-751f889efc24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:17.283763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397b898-df89-4d31-94ac-751f889efc24 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:17.284091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397b898-df89-4d31-94ac-751f889efc24 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:17.284386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397b898-df89-4d31-94ac-751f889efc24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:17.294721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397b898-df89-4d31-94ac-751f889efc24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:17.296426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397b898-df89-4d31-94ac-751f889efc24 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:17.306782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 952/1942] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:17.310676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5420d5-f102-4ef4-8e4a-0b5bff640c66 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:17.310876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5420d5-f102-4ef4-8e4a-0b5bff640c66 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:17.311182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5420d5-f102-4ef4-8e4a-0b5bff640c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:17.335593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3713a10f2cb4a6c81a4ca06d6f9a60d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:17.337242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1e5420d5-f102-4ef4-8e4a-0b5bff640c66 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:17.338438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1e5420d5-f102-4ef4-8e4a-0b5bff640c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:17.346703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3713a10f2cb4a6c81a4ca06d6f9a60d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:17.402151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 953/1943] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:17.403217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5420d5-f102-4ef4-8e4a-0b5bff640c66 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:17.414407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:17.458525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5420d5-f102-4ef4-8e4a-0b5bff640c66 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:17.462120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:17.462723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:17.463004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:17.463277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:17.465005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:17.495991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3713a10f2cb4a6c81a4ca06d6f9a60d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:17.509887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3713a10f2cb4a6c81a4ca06d6f9a60d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:17.510625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3713a10f2cb4a6c81a4ca06d6f9a60d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:17.517492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 991/1944] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:17 2022] DELETE /identity/v3/users/c3713a10f2cb4a6c81a4ca06d6f9a60d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:17.518279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:17.519615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:17.527490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:17.529283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:17.555367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 954/1945] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:17.593298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29c755-ff2c-4bce-be25-cd3b3393b518 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:17.598246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfde02-01eb-4a46-8b60-b84fa6be0e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:17.598246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfde02-01eb-4a46-8b60-b84fa6be0e08 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:17.598246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfde02-01eb-4a46-8b60-b84fa6be0e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:17.598246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfde02-01eb-4a46-8b60-b84fa6be0e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:17.600383 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-75bfde02-01eb-4a46-8b60-b84fa6be0e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:17.663549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfde02-01eb-4a46-8b60-b84fa6be0e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:17.664983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfde02-01eb-4a46-8b60-b84fa6be0e08 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:17.674640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 992/1946] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:17.705127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:17.806415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:17.819950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc61af-511b-42c6-bd91-1be74758ca53 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:17.825864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:17.826509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:17.826787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:17.828533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] PATH_INFO: `/v3/projects/944ba387570b4a048b7603dda55cd9c5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:17.828533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944ba387570b4a048b7603dda55cd9c5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:17.830290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:17.953240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944ba387570b4a048b7603dda55cd9c5', 'request_id': 'req-15880fd6-9132-4db2-9d02-474ab4922929'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:17.965527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:18.050659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944ba387570b4a048b7603dda55cd9c5', 'request_id': 'req-15880fd6-9132-4db2-9d02-474ab4922929'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:18.061462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944ba387570b4a048b7603dda55cd9c5', 'request_id': 'req-15880fd6-9132-4db2-9d02-474ab4922929'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:18.068851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] The token cache is being invalidate because project 944ba387570b4a048b7603dda55cd9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:18.069308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:18.070031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-15880fd6-9132-4db2-9d02-474ab4922929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:18.071638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 955/1947] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:17 2022] DELETE /identity/v3/projects/944ba387570b4a048b7603dda55cd9c5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:18.077609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bd648-5d9f-4101-9cea-cbeb7be9fe4c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.077951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bd648-5d9f-4101-9cea-cbeb7be9fe4c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.078138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bd648-5d9f-4101-9cea-cbeb7be9fe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.098819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6d1bd648-5d9f-4101-9cea-cbeb7be9fe4c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:18.100052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6d1bd648-5d9f-4101-9cea-cbeb7be9fe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:18.164455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 993/1948] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:18.172979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5916e-ea1c-4588-a1ad-a0e648e215fa None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.173294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5916e-ea1c-4588-a1ad-a0e648e215fa None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.173630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5916e-ea1c-4588-a1ad-a0e648e215fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.193847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-77a5916e-ea1c-4588-a1ad-a0e648e215fa None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:18.195035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-77a5916e-ea1c-4588-a1ad-a0e648e215fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:18.203791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 956/1949] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:18.212571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bd648-5d9f-4101-9cea-cbeb7be9fe4c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:18.223230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bd648-5d9f-4101-9cea-cbeb7be9fe4c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:18.227970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:18.228626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.228902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.229197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.229834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:18.230132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:18.232517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:18.244025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 994/1950] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:39:18.248680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5916e-ea1c-4588-a1ad-a0e648e215fa None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:18.259437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5916e-ea1c-4588-a1ad-a0e648e215fa None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:18.265747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:18.266428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.266428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.266678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.267289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:18.269347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:18.422324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 957/1951] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:18 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:18.422768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:18.435438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb882-16d7-446e-898f-d09ab4dbf01d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:18.500281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:18.500908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.501219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.501491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.502123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:18.504349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:18.634902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 995/1952] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:18 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:18.636157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:18.647817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a336-21ff-4856-89a5-2963a97797a9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:18.654535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:18.655433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.659747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.659747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.659747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:18.659747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:18.669554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 958/1953] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:18.673669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:18.683618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee12e1-9a48-40b1-ba3a-bae845024dd4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:18.691220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a64e65-e9fa-445e-820a-79e9646bcc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:18.691220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64e65-e9fa-445e-820a-79e9646bcc91 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.691220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64e65-e9fa-445e-820a-79e9646bcc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.691220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64e65-e9fa-445e-820a-79e9646bcc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.691574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a64e65-e9fa-445e-820a-79e9646bcc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:18.691574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a64e65-e9fa-445e-820a-79e9646bcc91 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:18.702292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 996/1954] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:18.706333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:18.716812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8d0f-8318-456d-bf5c-adbd0a9424fa admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:18.721533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:18.722180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.722457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.722726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] PATH_INFO: `/v3/projects/c65a0bdf9e4748f9b2eff53ef2907896/users/f3e6f939cefe497a86cce5db746adf25/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.738865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65a0bdf9e4748f9b2eff53ef2907896, user_id=f3e6f939cefe497a86cce5db746adf25, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:18.741601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:18.828588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 959/1955] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:18 2022] PUT /identity/v3/projects/c65a0bdf9e4748f9b2eff53ef2907896/users/f3e6f939cefe497a86cce5db746adf25/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:18.838907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:18.839195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:18.839467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:18.870015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] MFA Rules not processed for user `f3e6f939cefe497a86cce5db746adf25`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:18.871242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:18.934869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 997/1956] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:18.946119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:18.947815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:19.021038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22496f-84c6-496c-b2be-0b642be447ca admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:19.026597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714cb7a-03d8-41a3-8694-2e3c85df412b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:19.027202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714cb7a-03d8-41a3-8694-2e3c85df412b service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:19.027484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714cb7a-03d8-41a3-8694-2e3c85df412b service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:19.027792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714cb7a-03d8-41a3-8694-2e3c85df412b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:19.035619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714cb7a-03d8-41a3-8694-2e3c85df412b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:19.037237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714cb7a-03d8-41a3-8694-2e3c85df412b service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:19.052033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 960/1957] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:19.146232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:21.465904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:21.468083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:21.634828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc82f4-35f4-4bb3-9d18-86eda247087d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:21.639715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:21.640393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:21.640678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:21.640952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] PATH_INFO: `/v3/users/a509435ae8e94d0a9c207454df2a23d6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:21.653279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a509435ae8e94d0a9c207454df2a23d6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:21.655262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:21.875254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a509435ae8e94d0a9c207454df2a23d6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:21.902091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a509435ae8e94d0a9c207454df2a23d6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.002353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a509435ae8e94d0a9c207454df2a23d6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.005358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:22.020063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a509435ae8e94d0a9c207454df2a23d6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.020887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a509435ae8e94d0a9c207454df2a23d6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.031663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 998/1958] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:21 2022] DELETE /identity/v3/users/a509435ae8e94d0a9c207454df2a23d6 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:22.037351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:22.038284 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:22.038756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:22.063576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:22.063999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:22.127102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:22.155689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 961/1959] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:22.169263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:22.169263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:22.246415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cd215-4f99-4c5b-8109-12711fd7c896 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:22.250503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:22.251128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:22.251410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:22.251684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:22.262705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:22.264154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:22.277772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 999/1960] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:39:22.688955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:22.688955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:22.702735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402554a-a2e9-4f8e-bada-c9f49a9ec210 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:22.709116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:22.709762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:22.710036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:22.710472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] PATH_INFO: `/v3/users/f3e6f939cefe497a86cce5db746adf25` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:22.713646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e6f939cefe497a86cce5db746adf25)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:22.713981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:22.911212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e6f939cefe497a86cce5db746adf25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.911915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e6f939cefe497a86cce5db746adf25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.920098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e6f939cefe497a86cce5db746adf25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.937257 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e6f939cefe497a86cce5db746adf25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.938240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c1d4272a-bb75-4cf2-9e90-c1b674dc394e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e6f939cefe497a86cce5db746adf25'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:22.972353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:22.973954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:22.988894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e12382-3ff7-469e-8292-50230cf4040d service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:22.995804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:22.997248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:22.997794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:22.998168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] PATH_INFO: `/v3/projects/a4d3583b4521488894a2c25b431dfbad` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:23.000059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d3583b4521488894a2c25b431dfbad)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:23.002291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:23.038004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 962/1961] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:22 2022] DELETE /identity/v3/users/f3e6f939cefe497a86cce5db746adf25 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:23.047510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:23.047510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:23.047510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:23.072774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:23.074870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:23.138641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d3583b4521488894a2c25b431dfbad', 'request_id': 'req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.145273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d3583b4521488894a2c25b431dfbad', 'request_id': 'req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.155748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 963/1962] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:23.162414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:23.164213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:23.167083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d3583b4521488894a2c25b431dfbad', 'request_id': 'req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.251203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf827c8-3690-4b8f-b15e-85ffdca6564b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:23.318733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:23.319444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:23.319717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:23.319989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:23.329582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] The token cache is being invalidate because project a4d3583b4521488894a2c25b431dfbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:23.330142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.331460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.336236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1000/1963] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:22 2022] DELETE /identity/v3/projects/a4d3583b4521488894a2c25b431dfbad => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:23.337534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:23.339183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:23.439657 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47329d1f-99db-44a6-aa9f-1e8b1bfe1a6b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:23.445514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:23.446219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:23.446501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:23.446771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] PATH_INFO: `/v3/users/64ad61eccfb0475d9ee7d883cec69818` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:23.448934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ad61eccfb0475d9ee7d883cec69818)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:23.452271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:23.452529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:23.454595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:23.485601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 964/1964] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:39:23.594557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:23.668084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ad61eccfb0475d9ee7d883cec69818'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.678158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ad61eccfb0475d9ee7d883cec69818'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.740743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:23.779404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ad61eccfb0475d9ee7d883cec69818'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.820165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ad61eccfb0475d9ee7d883cec69818'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.820972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-33ac33a4-060c-4077-8df9-036bdea8dc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ad61eccfb0475d9ee7d883cec69818'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:23.832156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1001/1965] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:23 2022] DELETE /identity/v3/users/64ad61eccfb0475d9ee7d883cec69818 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:24.074163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:24.076611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:24.093888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02931-da85-4a93-9eff-7ec68ec2d9b9 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:24.178475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:24.184794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.184794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.184794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] PATH_INFO: `/v3/projects/c65a0bdf9e4748f9b2eff53ef2907896` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.184794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65a0bdf9e4748f9b2eff53ef2907896)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:24.184794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:24.346192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65a0bdf9e4748f9b2eff53ef2907896', 'request_id': 'req-e9941c3b-827b-4832-aa41-99d1ffc83a82'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.451773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65a0bdf9e4748f9b2eff53ef2907896', 'request_id': 'req-e9941c3b-827b-4832-aa41-99d1ffc83a82'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.458270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65a0bdf9e4748f9b2eff53ef2907896', 'request_id': 'req-e9941c3b-827b-4832-aa41-99d1ffc83a82'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.471914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] The token cache is being invalidate because project c65a0bdf9e4748f9b2eff53ef2907896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:24.472204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.472872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e9941c3b-827b-4832-aa41-99d1ffc83a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.474395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 965/1966] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:24 2022] DELETE /identity/v3/projects/c65a0bdf9e4748f9b2eff53ef2907896 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:24.479505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61c00-fe40-46f3-80bb-d0ffde7f7455 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.480023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61c00-fe40-46f3-80bb-d0ffde7f7455 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.480275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61c00-fe40-46f3-80bb-d0ffde7f7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.510746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-34d61c00-fe40-46f3-80bb-d0ffde7f7455 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:24.511934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-34d61c00-fe40-46f3-80bb-d0ffde7f7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:24.578891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1002/1967] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:24.587947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.591065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.591065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.610587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:24.611832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:24.620279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 966/1968] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:24.625245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d61c00-fe40-46f3-80bb-d0ffde7f7455 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:24.635275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d61c00-fe40-46f3-80bb-d0ffde7f7455 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:24.643343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:24.644316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.644691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.645116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.651528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:24.652157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:24.652157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:24.652356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:24.652445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:24.662549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1832-5dd5-489d-9e3f-b61e524f84a1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:24.667592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:24.668974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.669550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.669770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] PATH_INFO: `/v3/projects/9045ecedd2c04f7cbe253336fe71c88e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.670987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9045ecedd2c04f7cbe253336fe71c88e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:24.673135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:24.680350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1003/1969] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:39:24.682023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:24.709324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfdeb5-6fa9-420a-8086-84a374ca6e21 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:24.711995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:24.712611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.713099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.713522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.714294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:24.716333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:24.823332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1004/1970] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:24 2022] POST /identity/v3/projects => generated 355 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:24.827762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:24.841391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9045ecedd2c04f7cbe253336fe71c88e', 'request_id': 'req-d102586b-fdcd-401f-8fef-7bb6817fa609'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.910899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9045ecedd2c04f7cbe253336fe71c88e', 'request_id': 'req-d102586b-fdcd-401f-8fef-7bb6817fa609'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.916637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fb50e-ffa4-444d-b218-d462dff45ded admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:24.918124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9045ecedd2c04f7cbe253336fe71c88e', 'request_id': 'req-d102586b-fdcd-401f-8fef-7bb6817fa609'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.922820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:24.923641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.923985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.924331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.925329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:24.928208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:24.931482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] The token cache is being invalidate because project 9045ecedd2c04f7cbe253336fe71c88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:24.931862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.932709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d102586b-fdcd-401f-8fef-7bb6817fa609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:24.935142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 967/1971] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:24 2022] DELETE /identity/v3/projects/9045ecedd2c04f7cbe253336fe71c88e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:24.940300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cca20-ab7a-42ed-ac78-b15469381547 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.940901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cca20-ab7a-42ed-ac78-b15469381547 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.940901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cca20-ab7a-42ed-ac78-b15469381547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:24.964618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bb2cca20-ab7a-42ed-ac78-b15469381547 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:24.966777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bb2cca20-ab7a-42ed-ac78-b15469381547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:24.975372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 968/1972] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:24.983587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da40fd-7ec6-44c0-aab1-ede25fe1a15c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:24.985578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da40fd-7ec6-44c0-aab1-ede25fe1a15c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:24.985578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da40fd-7ec6-44c0-aab1-ede25fe1a15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.005231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-50da40fd-7ec6-44c0-aab1-ede25fe1a15c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:25.006463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-50da40fd-7ec6-44c0-aab1-ede25fe1a15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:25.019058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 969/1973] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:25.024004 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da40fd-7ec6-44c0-aab1-ede25fe1a15c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.034852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da40fd-7ec6-44c0-aab1-ede25fe1a15c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.040642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.042921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.042921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.042921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.042921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:25.042921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.047297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1005/1974] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:24 2022] POST /identity/v3/users => generated 278 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:25.047439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.048979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.050781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:25.062341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 970/1975] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:39:25.065959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.066170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:25.067579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6965541-7472-4d28-bff9-591727ee0251 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.072786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.073479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.073756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.074030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.074675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.077006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.082069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18922-bf28-4897-82f4-05065e9f485d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.087645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8b5c7-34cc-4516-b815-806add25eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.089130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8b5c7-34cc-4516-b815-806add25eb80 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.089130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8b5c7-34cc-4516-b815-806add25eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.092623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8b5c7-34cc-4516-b815-806add25eb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.096227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1006/1976] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:25.096535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8b5c7-34cc-4516-b815-806add25eb80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.096535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8b5c7-34cc-4516-b815-806add25eb80 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.096691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.109640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e95ffb-8008-4599-bb5e-8c3320f64dfa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.120698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.121356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.122200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.122484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.123217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.125107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.141938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1007/1977] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:25.143071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.165941 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f39fb-8758-4432-9787-d63c7c70bcd5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.172643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.173493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.173785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.174048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] PATH_INFO: `/v3/projects/c6de28a57fac4f73892540a25d4bd354/users/9c9175ce95ff485a902e28cf02992529/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.177357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:25.209117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6de28a57fac4f73892540a25d4bd354, user_id=9c9175ce95ff485a902e28cf02992529, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.210951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.346523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1008/1978] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:25 2022] PUT /identity/v3/projects/c6de28a57fac4f73892540a25d4bd354/users/9c9175ce95ff485a902e28cf02992529/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:25.348916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 971/1979] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:25 2022] POST /identity/v3/projects => generated 393 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:25.366607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a74229-3fb7-4603-988c-4e7b69123925 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.367498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.368328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a74229-3fb7-4603-988c-4e7b69123925 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.369155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a74229-3fb7-4603-988c-4e7b69123925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.416781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-49a74229-3fb7-4603-988c-4e7b69123925 None None] MFA Rules not processed for user `9c9175ce95ff485a902e28cf02992529`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:25.418422 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-49a74229-3fb7-4603-988c-4e7b69123925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:25.485010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369dee9-e1c6-4bc8-8b4b-3573fb49d46a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.534122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 972/1980] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:25.540016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a74229-3fb7-4603-988c-4e7b69123925 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.583618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775c3a-c208-484f-8afd-aee540250236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.584380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775c3a-c208-484f-8afd-aee540250236 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.584762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775c3a-c208-484f-8afd-aee540250236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.585207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775c3a-c208-484f-8afd-aee540250236 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.585940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c775c3a-c208-484f-8afd-aee540250236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.588147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c775c3a-c208-484f-8afd-aee540250236 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.620956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a74229-3fb7-4603-988c-4e7b69123925 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.631441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.631826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.632166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.632464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.633141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.635312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.673977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1009/1981] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:25 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:25.675250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8c298-e9fa-4806-9cb5-ad4209bbbf96 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.676033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8c298-e9fa-4806-9cb5-ad4209bbbf96 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.676314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8c298-e9fa-4806-9cb5-ad4209bbbf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.705208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ace8c298-e9fa-4806-9cb5-ad4209bbbf96 None None] MFA Rules not processed for user `fc1418800d0b4cf2b21ce9556f92e20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:25.706434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ace8c298-e9fa-4806-9cb5-ad4209bbbf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:25.738306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 973/1982] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:25 2022] POST /identity/v3/projects => generated 355 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:25.739245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.788284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1010/1983] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:25.789464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8c298-e9fa-4806-9cb5-ad4209bbbf96 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.800445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8c298-e9fa-4806-9cb5-ad4209bbbf96 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.828703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7cbae-8bd8-4589-a2aa-8463ae98f4cc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.833686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.834302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.834587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.834861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.835560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.837189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.855525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 974/1984] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:25.855525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.859656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:25.863259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:25.875751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.875939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7646e-2d39-40ed-8277-fa621952f353 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.876041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.876041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.876041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.876041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.877618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.878448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.879055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.879340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.879607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.880234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.882231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:25.894910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:25.976991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1011/1985] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:25 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:25.976991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:25.986471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0244a5-3e32-45ae-a2a5-0a8de1ab4f27 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:25.992737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:25.993510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:25.996256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:25.996256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:25.996256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:25.996525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.002576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 975/1986] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:25 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:26.002576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.008488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1012/1987] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:26.009279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.020851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0e26-10c9-401d-8906-c5145740d68e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.077398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ece4f-7365-420c-9554-59f954a7b659 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.082841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.083780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.084131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.084474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.085246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.085372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.086277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.086630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.086977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.087327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.087751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.089862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.105513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 976/1988] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:26.105513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.112430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7309bb-f9ae-4951-a9f6-75968c030ed5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.118348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.118601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.118881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.119155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] PATH_INFO: `/v3/projects/77733ed9cbd345b2b67c6f380a7f2540/users/ad90b92a0d724eecae57d530b9eefacc/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.136227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77733ed9cbd345b2b67c6f380a7f2540, user_id=ad90b92a0d724eecae57d530b9eefacc, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.139040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.240096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1013/1989] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:26 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:26.240948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.250564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2729-14d4-4506-9813-a4bbf85e05d5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.255195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.255980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.256257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.256555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] PATH_INFO: `/v3/projects/582a9440e694448ab0146406d4ee9d08/users/34559d0c0b7e4f46b3d1aa40d4894215/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.272730 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] RBAC: Authorizing `identity:create_grant(project_id=582a9440e694448ab0146406d4ee9d08, user_id=34559d0c0b7e4f46b3d1aa40d4894215, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.275508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.287329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 977/1990] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:26 2022] PUT /identity/v3/projects/77733ed9cbd345b2b67c6f380a7f2540/users/ad90b92a0d724eecae57d530b9eefacc/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:26.288571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.360769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60dd57-a3bb-403c-aecd-e5baf5dab4b1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.365625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b764f-2f3d-4d57-97df-ca0f146da129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.366237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b764f-2f3d-4d57-97df-ca0f146da129 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.366514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b764f-2f3d-4d57-97df-ca0f146da129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.366785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b764f-2f3d-4d57-97df-ca0f146da129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.367468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b764f-2f3d-4d57-97df-ca0f146da129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.369110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b764f-2f3d-4d57-97df-ca0f146da129 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.380449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 978/1991] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:26.381722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b399cb-1eed-4c73-9385-bf821c2c9e3f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.381987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b399cb-1eed-4c73-9385-bf821c2c9e3f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.382259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b399cb-1eed-4c73-9385-bf821c2c9e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.386789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1014/1992] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:26 2022] PUT /identity/v3/projects/582a9440e694448ab0146406d4ee9d08/users/34559d0c0b7e4f46b3d1aa40d4894215/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:26.391298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.415445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:26.419706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-99b399cb-1eed-4c73-9385-bf821c2c9e3f None None] MFA Rules not processed for user `ad90b92a0d724eecae57d530b9eefacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:26.421823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-99b399cb-1eed-4c73-9385-bf821c2c9e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:26.519214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 979/1993] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:26.520313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b399cb-1eed-4c73-9385-bf821c2c9e3f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.533665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b399cb-1eed-4c73-9385-bf821c2c9e3f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.537793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19a5b0-282c-4bbf-82d7-a37b42e5296d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.543552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.544594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.545526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.546174 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.546568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.546858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.547100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] PATH_INFO: `/v3/projects/f03df1112ed749869890525997db4717/users/a7eb4fba8f2840d190b478251a84b023/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.547206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.547781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.551175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.566904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 980/1994] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:26.567745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.574045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03df1112ed749869890525997db4717, user_id=a7eb4fba8f2840d190b478251a84b023, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.581775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.583330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b3b7-7281-4267-b793-9243237a775b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.589699 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.590477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.591461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.591738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.592486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.594768 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.674136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1015/1995] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:26 2022] PUT /identity/v3/projects/f03df1112ed749869890525997db4717/users/a7eb4fba8f2840d190b478251a84b023/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:26.675319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.708958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 981/1996] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:26 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:26.710557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.754177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ffedf-4c63-4346-adcc-709b2f71ced8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.781819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fa0fb-e246-4387-9e07-43e02bf53e5d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.787261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.787867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.788141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.788413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.789073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.790669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.801587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 982/1997] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:26.802464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.815309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011d46b-6cd0-4cfd-87a3-d8768e728946 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.818668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.819349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.819627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.819898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] PATH_INFO: `/v3/projects/582a9440e694448ab0146406d4ee9d08/users/34559d0c0b7e4f46b3d1aa40d4894215/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.820356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1c10b-c7ab-47e1-bc17-16bdfcc3fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.821063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1c10b-c7ab-47e1-bc17-16bdfcc3fc7f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.821379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1c10b-c7ab-47e1-bc17-16bdfcc3fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.821658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1c10b-c7ab-47e1-bc17-16bdfcc3fc7f admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.821954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582a9440e694448ab0146406d4ee9d08, user_id=34559d0c0b7e4f46b3d1aa40d4894215, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.822291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1c10b-c7ab-47e1-bc17-16bdfcc3fc7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.824234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1c10b-c7ab-47e1-bc17-16bdfcc3fc7f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.824740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.838644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:26.839337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1016/1998] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:26 2022] PUT /identity/v3/projects/582a9440e694448ab0146406d4ee9d08/users/34559d0c0b7e4f46b3d1aa40d4894215/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:26.840156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.923116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb010740-630d-491e-b3e1-f261b7b09c18 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:26.929482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:26.933950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.933950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.933950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] PATH_INFO: `/v3/projects/f03df1112ed749869890525997db4717/users/a7eb4fba8f2840d190b478251a84b023/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.933950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03df1112ed749869890525997db4717, user_id=a7eb4fba8f2840d190b478251a84b023, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:26.937863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:26.939290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 983/1999] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:26 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:26.940627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:26.940809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:26.941102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:26.951683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1017/2000] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:26 2022] PUT /identity/v3/projects/f03df1112ed749869890525997db4717/users/a7eb4fba8f2840d190b478251a84b023/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:26.952512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:26.977631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] MFA Rules not processed for user `34559d0c0b7e4f46b3d1aa40d4894215`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:26.978919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:27.026643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be327b-bf16-463b-b472-c9933e8f65b5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.034466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.035690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.036741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.036741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.042449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.046664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.060243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1018/2001] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:27.065556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:27.067085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 984/2002] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:27.077210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:27.078781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:27.087887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd0e6-fd6e-43e9-b704-2f6e53f6d3f1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.094936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.095741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.096506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.096869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] PATH_INFO: `/v3/projects/67d399be03444aaabf7f3743f249d5f0/users/37294f287c58463f96c44f76c90d33a7/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.118475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d399be03444aaabf7f3743f249d5f0, user_id=37294f287c58463f96c44f76c90d33a7, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.122948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.138304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:27.169876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530c303-84c4-485c-ba2a-46b030bde976 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.182783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.184011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.184011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.185397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.208892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.210600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.229895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 985/2003] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:27.232871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1019/2004] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:27 2022] PUT /identity/v3/projects/67d399be03444aaabf7f3743f249d5f0/users/37294f287c58463f96c44f76c90d33a7/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:27.237060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:27.262022 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878aad-3b8e-4f0b-a2a7-43054f6cf279 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.375134 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e917-d7b9-44a9-ac5e-a09225f38308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.375822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e917-d7b9-44a9-ac5e-a09225f38308 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.376303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e917-d7b9-44a9-ac5e-a09225f38308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.376489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e917-d7b9-44a9-ac5e-a09225f38308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.377831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3e917-d7b9-44a9-ac5e-a09225f38308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.402714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3e917-d7b9-44a9-ac5e-a09225f38308 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.428149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 986/2005] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:27.432358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:27.453623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5718-9da1-4c0a-942b-4a4bfe656ce6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.459336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.460022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.460301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.460595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] PATH_INFO: `/v3/projects/67d399be03444aaabf7f3743f249d5f0/users/37294f287c58463f96c44f76c90d33a7/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.462633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d399be03444aaabf7f3743f249d5f0, user_id=37294f287c58463f96c44f76c90d33a7, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.467700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.483590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1020/2006] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:27 2022] PUT /identity/v3/projects/67d399be03444aaabf7f3743f249d5f0/users/37294f287c58463f96c44f76c90d33a7/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:27.496002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.496293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.497093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.536356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] MFA Rules not processed for user `37294f287c58463f96c44f76c90d33a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:27.538014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:27.576261 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:27.644734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 987/2007] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:27.660909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:27.663743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:27.673374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e1f2-1256-430d-84d6-4c5b52fecf9a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.678130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.678759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.679116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.681405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.689375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f6a1f-ed77-4aa0-8c97-0e6f85dd26d5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.689923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.691591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.692089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.692591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.709966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.711493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.723263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 988/2008] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:27.782966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:27.793776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.795874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.806790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1021/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:27.832413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:27.842746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c277e-c2f3-4b54-9794-18276bd3702d service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:27.848622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e3eb5-5c0b-43d9-bbfc-80a738be04b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:27.849435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e3eb5-5c0b-43d9-bbfc-80a738be04b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:27.849783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e3eb5-5c0b-43d9-bbfc-80a738be04b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:27.850119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e3eb5-5c0b-43d9-bbfc-80a738be04b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:27.933712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e3eb5-5c0b-43d9-bbfc-80a738be04b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:27.935964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e3eb5-5c0b-43d9-bbfc-80a738be04b4 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:27.945687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:27.946644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 989/2010] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:29.282930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:33.611934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:33.718946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c7dfb-6832-40b1-9004-55db36b27291 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:33.724472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:33.726402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:33.727006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:33.727489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] PATH_INFO: `/v3/users/ad90b92a0d724eecae57d530b9eefacc` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:33.729095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad90b92a0d724eecae57d530b9eefacc)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:33.733612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:33.968834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:33.969480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:33.970443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:33.972020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad90b92a0d724eecae57d530b9eefacc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:33.980097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad90b92a0d724eecae57d530b9eefacc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:34.003638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] MFA Rules not processed for user `a7eb4fba8f2840d190b478251a84b023`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:34.004898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:34.049970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad90b92a0d724eecae57d530b9eefacc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:34.066572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:34.080914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad90b92a0d724eecae57d530b9eefacc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:34.082142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b4e3f7c-01d9-4509-bbf6-0e506fd87e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad90b92a0d724eecae57d530b9eefacc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:34.091761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1022/2011] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:33 2022] DELETE /identity/v3/users/ad90b92a0d724eecae57d530b9eefacc => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:34.095219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:34.095613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:34.096055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:34.105800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 990/2012] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:34.125919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:34.127288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:34.134011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:34.135580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:34.222139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:34.235578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1023/2013] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:34.241264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cdfbb-d9e6-4ef6-9d50-90d466c5d812 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:34.250936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:34.252642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:34.307984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:34.308680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:34.308965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:34.309403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:34.311852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:34.331693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b68f8-adeb-4b01-885f-20feb53c56ae None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:34.335482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e705c6-9286-45d0-9ebb-af0650d0a46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:34.336096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e705c6-9286-45d0-9ebb-af0650d0a46f service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:34.336373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e705c6-9286-45d0-9ebb-af0650d0a46f service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:34.336669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e705c6-9286-45d0-9ebb-af0650d0a46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:34.346525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e705c6-9286-45d0-9ebb-af0650d0a46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:34.347963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e705c6-9286-45d0-9ebb-af0650d0a46f service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:34.358888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1024/2014] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:34.383557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:34.385552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:34.398903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 991/2015] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:34.734288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:34.734816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:34.734816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:34.754094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:34.762168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:34.821293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1025/2016] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:34.877648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:34.883162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:34.895296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156359-7657-49bf-aec9-8d613ea0de31 service glance] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:34.900620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:34.901543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:34.901931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:34.902316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] PATH_INFO: `/v3/projects/77733ed9cbd345b2b67c6f380a7f2540` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:34.904265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77733ed9cbd345b2b67c6f380a7f2540)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:34.906663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:34.918340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:34.921771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:35.018212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822527d8-0af0-4e3d-bea2-15681083ec75 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:35.032847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:35.033845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:35.034126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:35.034212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:35.045951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:35.049322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:35.050651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:35.053432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77733ed9cbd345b2b67c6f380a7f2540', 'request_id': 'req-261db203-9ffe-46a8-a197-e22209f0f34c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.060795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1026/2017] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:39:35.106001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77733ed9cbd345b2b67c6f380a7f2540', 'request_id': 'req-261db203-9ffe-46a8-a197-e22209f0f34c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.120016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77733ed9cbd345b2b67c6f380a7f2540', 'request_id': 'req-261db203-9ffe-46a8-a197-e22209f0f34c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.133077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] The token cache is being invalidate because project 77733ed9cbd345b2b67c6f380a7f2540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:35.133378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.137287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.137287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 992/2018] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:34 2022] DELETE /identity/v3/projects/77733ed9cbd345b2b67c6f380a7f2540 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:35.140708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:35.153075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a5ab-196c-4852-8216-4e43f40eab12 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:35.221501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:35.282366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:35.283388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:35.283839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:35.284496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] PATH_INFO: `/v3/users/37294f287c58463f96c44f76c90d33a7` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:35.298793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37294f287c58463f96c44f76c90d33a7)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:35.305280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:35.510244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37294f287c58463f96c44f76c90d33a7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.522840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37294f287c58463f96c44f76c90d33a7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.617666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37294f287c58463f96c44f76c90d33a7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.639681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37294f287c58463f96c44f76c90d33a7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.640451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d1063908-9b22-471c-a53a-a6bc4d5369c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37294f287c58463f96c44f76c90d33a7'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:35.654647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1027/2019] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:35 2022] DELETE /identity/v3/users/37294f287c58463f96c44f76c90d33a7 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:36.739490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:36.739490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:36.770663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db203-9ffe-46a8-a197-e22209f0f34c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:36.901394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:36.912246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:36.912246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:36.912246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] PATH_INFO: `/v3/projects/67d399be03444aaabf7f3743f249d5f0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:36.912246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d399be03444aaabf7f3743f249d5f0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:36.914302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:37.068789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d399be03444aaabf7f3743f249d5f0', 'request_id': 'req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:37.155985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d399be03444aaabf7f3743f249d5f0', 'request_id': 'req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:37.166802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d399be03444aaabf7f3743f249d5f0', 'request_id': 'req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:37.198447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] The token cache is being invalidate because project 67d399be03444aaabf7f3743f249d5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:37.198829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:37.205003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4ebb0d4f-39b8-49e5-bebc-278d9eb98f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:37.214266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 993/2020] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:36 2022] DELETE /identity/v3/projects/67d399be03444aaabf7f3743f249d5f0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:37.217361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511b1f-b89c-4e55-98c7-83ff4cf0bd7f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:37.217361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511b1f-b89c-4e55-98c7-83ff4cf0bd7f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:37.218006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511b1f-b89c-4e55-98c7-83ff4cf0bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:37.294773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-70511b1f-b89c-4e55-98c7-83ff4cf0bd7f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:37.297191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-70511b1f-b89c-4e55-98c7-83ff4cf0bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:37.439242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1028/2021] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:37.447549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91f99-c174-45b3-83e2-ab8d2ec59451 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:37.447839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91f99-c174-45b3-83e2-ab8d2ec59451 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:37.448118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91f99-c174-45b3-83e2-ab8d2ec59451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:37.475193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-50e91f99-c174-45b3-83e2-ab8d2ec59451 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:37.476430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-50e91f99-c174-45b3-83e2-ab8d2ec59451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:37.505964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 994/2022] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:37.510347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511b1f-b89c-4e55-98c7-83ff4cf0bd7f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:37.521016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511b1f-b89c-4e55-98c7-83ff4cf0bd7f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:37.535103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:37.536123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:37.536415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:37.536697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:37.538580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:37.538580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:37.540561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:37.568103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e91f99-c174-45b3-83e2-ab8d2ec59451 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:37.574561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1029/2023] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:39:37.579346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e91f99-c174-45b3-83e2-ab8d2ec59451 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:37.593506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:37.594149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:37.594433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:37.594708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:37.599167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:37.602241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:37.728175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:37.747120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 995/2024] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:37 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:37.750573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce3bb-42d6-4f60-81a7-920dfe859910 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:37.866596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:37.909644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:37.910709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:37.911436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:37.911940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:37.912811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:37.914826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:38.016701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1030/2025] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:37 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:38.022744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:38.037555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b38e7-4aad-4dc1-bc08-4683dd71de5e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:38.051894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:38.052846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:38.057854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:38.057854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:38.057854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:38.057854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:38.070992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 996/2026] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:39:38.074674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:38.085766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a49bd-b45a-4a76-8721-050496042db6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:38.093379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb8e6-b06b-48f0-9ff8-5657ad0799ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:38.094024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb8e6-b06b-48f0-9ff8-5657ad0799ad admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:38.094302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb8e6-b06b-48f0-9ff8-5657ad0799ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:38.094576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb8e6-b06b-48f0-9ff8-5657ad0799ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:38.095246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb8e6-b06b-48f0-9ff8-5657ad0799ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:38.096878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb8e6-b06b-48f0-9ff8-5657ad0799ad admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:38.116194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1031/2027] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:38.117708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:38.131049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341b68-f84b-48e4-bb8c-b0c579df15e5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:38.136770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:38.137805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:38.138440 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:38.139100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] PATH_INFO: `/v3/projects/dc93f2a20e664562bb408c0033c51d1f/users/b744450918fe4cc794a8df616bf161e0/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:38.187332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc93f2a20e664562bb408c0033c51d1f, user_id=b744450918fe4cc794a8df616bf161e0, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:38.191296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:38.304568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:38.321512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 997/2028] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:38 2022] PUT /identity/v3/projects/dc93f2a20e664562bb408c0033c51d1f/users/b744450918fe4cc794a8df616bf161e0/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:38.323386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28798c-577d-4c95-af83-4d8e75500cf6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:38.323875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28798c-577d-4c95-af83-4d8e75500cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:38.324082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28798c-577d-4c95-af83-4d8e75500cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:38.437103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5e28798c-577d-4c95-af83-4d8e75500cf6 None None] MFA Rules not processed for user `b744450918fe4cc794a8df616bf161e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:38.440066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5e28798c-577d-4c95-af83-4d8e75500cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:38.713271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1032/2029] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:38.714532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:38.824857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d75f75-ed6f-4123-978a-e67cfefe0450 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:38.828922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:38.829594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:38.829938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:38.830191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:38.830827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:38.833105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:38.989130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 998/2030] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:38 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:38.993497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28798c-577d-4c95-af83-4d8e75500cf6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:39.015504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28798c-577d-4c95-af83-4d8e75500cf6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:39.116446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:39.117453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:39.117728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:39.117998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:39.118632 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:39.120998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:39.230058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1033/2031] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:38 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:39.234539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:39.256861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8930a5-347e-428f-9858-78d0689198d6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:39.267268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:39.270203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:39.270203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:39.270203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:39.270676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:39.272307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:39.288575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 999/2032] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:39.289984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:39.322083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250357b9-65bc-4410-8e3a-f51a168efa6d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:39.327964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:39.328702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:39.329047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:39.329427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] PATH_INFO: `/v3/projects/f9b310b830074e78849a0c39257435b2/users/b6802f5f24fd4f5cb38a005414e7cd01/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:39.374529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b310b830074e78849a0c39257435b2, user_id=b6802f5f24fd4f5cb38a005414e7cd01, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:39.374787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:39.569591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1034/2033] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:39 2022] PUT /identity/v3/projects/f9b310b830074e78849a0c39257435b2/users/b6802f5f24fd4f5cb38a005414e7cd01/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:39.578492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:39.586218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c9513-0772-47c6-98bd-49dc6c7e9c1b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:39.655199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b015e8-aa66-4ebf-ae7b-de934fb33f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:39.655814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b015e8-aa66-4ebf-ae7b-de934fb33f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:39.656093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b015e8-aa66-4ebf-ae7b-de934fb33f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:39.656367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b015e8-aa66-4ebf-ae7b-de934fb33f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:39.657011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b015e8-aa66-4ebf-ae7b-de934fb33f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:39.658665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b015e8-aa66-4ebf-ae7b-de934fb33f1a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:39.668819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1000/2034] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:39.673538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:39.683705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127b768-e1a0-44e2-a278-29ca9de5348f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:39.689016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:39.689696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:39.689970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:39.690242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] PATH_INFO: `/v3/projects/f9b310b830074e78849a0c39257435b2/users/b6802f5f24fd4f5cb38a005414e7cd01/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:39.692146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b310b830074e78849a0c39257435b2, user_id=b6802f5f24fd4f5cb38a005414e7cd01, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:39.694844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:39.705824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1035/2035] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:39 2022] PUT /identity/v3/projects/f9b310b830074e78849a0c39257435b2/users/b6802f5f24fd4f5cb38a005414e7cd01/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:39.715962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:39.716846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:39.717159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:39.747668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] MFA Rules not processed for user `b6802f5f24fd4f5cb38a005414e7cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:39.748884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:39.811030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:39.821783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1001/2036] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:39.833918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:39.835579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:39.841791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:39.901514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6bfb2-de64-433b-b5e6-b09487a08f4f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:39.905948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:39.906560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:39.906843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:39.907116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:39.917215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:39.918643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:39.929161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1036/2037] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:40.168632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:40.170299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:40.185349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792995a-f3ba-4daa-8aca-7e068a13480e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:40.192260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8424f79-cfe0-4974-98aa-d6ea2dfb1973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:40.192961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8424f79-cfe0-4974-98aa-d6ea2dfb1973 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:40.193472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8424f79-cfe0-4974-98aa-d6ea2dfb1973 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:40.193843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8424f79-cfe0-4974-98aa-d6ea2dfb1973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:40.280025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8424f79-cfe0-4974-98aa-d6ea2dfb1973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:40.281873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8424f79-cfe0-4974-98aa-d6ea2dfb1973 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:40.295000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1002/2038] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:41.260770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:41.374837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523fec6-e303-4d6b-9868-3f1a888b0fed service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:41.380806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:41.381475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:41.384416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:41.384416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] PATH_INFO: `/v3/users/b744450918fe4cc794a8df616bf161e0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:41.384416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b744450918fe4cc794a8df616bf161e0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:41.386668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:41.639556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b744450918fe4cc794a8df616bf161e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:41.647299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b744450918fe4cc794a8df616bf161e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:41.757623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b744450918fe4cc794a8df616bf161e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:41.774545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b744450918fe4cc794a8df616bf161e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:41.775308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b744450918fe4cc794a8df616bf161e0'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:41.782915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1037/2039] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:41 2022] DELETE /identity/v3/users/b744450918fe4cc794a8df616bf161e0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:41.787635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:41.788146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:41.788253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:41.810344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:41.811692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:41.892581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1003/2040] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:41.899355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:41.900897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:41.940122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:41.978515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48df9f-944f-4775-ab10-089e42ccd7bf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:41.984885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:41.985548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:41.985831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:41.986100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:41.996394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:41.998361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:42.010717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1038/2041] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:39:42.558360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:42.561003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:42.575085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e316-8e2d-411b-bf6b-bf4510eee677 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:42.580646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:42.581444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:42.581793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:42.582086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] PATH_INFO: `/v3/projects/dc93f2a20e664562bb408c0033c51d1f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:42.586677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc93f2a20e664562bb408c0033c51d1f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:42.588755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:42.737091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc93f2a20e664562bb408c0033c51d1f', 'request_id': 'req-106d4b89-7720-4bfe-b45a-4ce75a083bec'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:42.825983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc93f2a20e664562bb408c0033c51d1f', 'request_id': 'req-106d4b89-7720-4bfe-b45a-4ce75a083bec'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:42.835113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc93f2a20e664562bb408c0033c51d1f', 'request_id': 'req-106d4b89-7720-4bfe-b45a-4ce75a083bec'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:42.847626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] The token cache is being invalidate because project dc93f2a20e664562bb408c0033c51d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:42.848034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:42.848758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-106d4b89-7720-4bfe-b45a-4ce75a083bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:42.850625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1004/2042] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:42 2022] DELETE /identity/v3/projects/dc93f2a20e664562bb408c0033c51d1f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:42.856577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:42.888790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74a16b-8699-43e3-8456-531f01180403 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:42.966126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:42.967649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:42.967649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:42.967997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] PATH_INFO: `/v3/users/b6802f5f24fd4f5cb38a005414e7cd01` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:42.969219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6802f5f24fd4f5cb38a005414e7cd01)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:42.971201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:43.051133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:43.051437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:43.051710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:43.074549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:43.075807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:43.086649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:43.140525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1005/2043] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:43.154180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:43.155674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:43.243629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389d04f-1c83-4fe4-84be-cb8eba134a1a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:43.249396 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:43.250169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:43.250448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:43.250781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:43.259866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:43.261520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:43.271085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1006/2044] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 21:39:43.663042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6802f5f24fd4f5cb38a005414e7cd01'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:43.669882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6802f5f24fd4f5cb38a005414e7cd01'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:43.871751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6802f5f24fd4f5cb38a005414e7cd01'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:43.885212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6802f5f24fd4f5cb38a005414e7cd01'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:43.885795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-daf083d8-6ecc-48fe-b9f9-8c14556dc1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6802f5f24fd4f5cb38a005414e7cd01'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:43.892599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1039/2045] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:42 2022] DELETE /identity/v3/users/b6802f5f24fd4f5cb38a005414e7cd01 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:44.606766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:44.608526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:44.650331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedba2e-e9a5-43c3-a180-9adb7a022521 service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:44.780953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:44.782333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:44.785404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:44.785981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] PATH_INFO: `/v3/projects/f9b310b830074e78849a0c39257435b2` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:44.787719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b310b830074e78849a0c39257435b2)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:44.793135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:44.928531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b310b830074e78849a0c39257435b2', 'request_id': 'req-b95baee5-8e49-406a-ae8f-1abe80bcbe21'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:44.936217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:45.045572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b310b830074e78849a0c39257435b2', 'request_id': 'req-b95baee5-8e49-406a-ae8f-1abe80bcbe21'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:45.058595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b310b830074e78849a0c39257435b2', 'request_id': 'req-b95baee5-8e49-406a-ae8f-1abe80bcbe21'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:45.078718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] The token cache is being invalidate because project f9b310b830074e78849a0c39257435b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:45.078718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:45.079101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b95baee5-8e49-406a-ae8f-1abe80bcbe21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:45.084320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1007/2046] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:44 2022] DELETE /identity/v3/projects/f9b310b830074e78849a0c39257435b2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:45.086080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5eb0-5eb1-42bd-abb9-fc359dd5e84c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:45.086542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5eb0-5eb1-42bd-abb9-fc359dd5e84c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:45.086647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5eb0-5eb1-42bd-abb9-fc359dd5e84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:45.114990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0fec5eb0-5eb1-42bd-abb9-fc359dd5e84c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:45.116211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0fec5eb0-5eb1-42bd-abb9-fc359dd5e84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:45.174889 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:45.198707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1040/2047] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:45.204649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e260d6-9f4d-4d43-a4f3-86bcb49f0f94 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:45.204995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e260d6-9f4d-4d43-a4f3-86bcb49f0f94 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:45.205382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e260d6-9f4d-4d43-a4f3-86bcb49f0f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:45.230828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-07e260d6-9f4d-4d43-a4f3-86bcb49f0f94 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:45.232674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-07e260d6-9f4d-4d43-a4f3-86bcb49f0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:45.248318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1008/2048] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:45.249252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec5eb0-5eb1-42bd-abb9-fc359dd5e84c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:45.271195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec5eb0-5eb1-42bd-abb9-fc359dd5e84c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:45.276416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:45.278122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:45.278591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:45.279562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:45.280236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:45.280541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:45.282260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:45.315734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1041/2049] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:39:45.320535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e260d6-9f4d-4d43-a4f3-86bcb49f0f94 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:45.337958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e260d6-9f4d-4d43-a4f3-86bcb49f0f94 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:45.352569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:45.353256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:45.353559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:45.353825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:45.354999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:45.357281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:45.479541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1009/2050] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:45 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:45.484882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:45.497150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb29cc4-ab61-43b5-b3e7-9c57aafdb898 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:45.611136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:45.611821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:45.612102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:45.612384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:45.614857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:45.622238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:45.749020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1042/2051] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:45 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:45.753653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:45.835824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c434-2448-45ba-9f17-a7028d698100 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:45.873007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:45.873765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:45.874053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:45.874320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:45.874990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:45.896832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:45.951329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1010/2052] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:45.964129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:46.004052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da8886-29c8-4d33-92ea-1ad81a812db5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:46.027619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff42896-a326-452b-af0d-94dff54c20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:46.029675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff42896-a326-452b-af0d-94dff54c20ea admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:46.030125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff42896-a326-452b-af0d-94dff54c20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:46.030745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff42896-a326-452b-af0d-94dff54c20ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:46.036719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff42896-a326-452b-af0d-94dff54c20ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:46.038822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff42896-a326-452b-af0d-94dff54c20ea admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:46.080073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:46.086301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1043/2053] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:46.095610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a131d5-0d5f-460a-862c-24235ee49068 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:46.123510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:46.124166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:46.124427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:46.124704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] PATH_INFO: `/v3/projects/802a0282efc04c02935310e6043958ac/users/d0233760befd4174814aeadb9a2d21e5/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:46.175403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802a0282efc04c02935310e6043958ac, user_id=d0233760befd4174814aeadb9a2d21e5, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:46.179444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:46.296103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1011/2054] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:46 2022] PUT /identity/v3/projects/802a0282efc04c02935310e6043958ac/users/d0233760befd4174814aeadb9a2d21e5/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:46.307058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526cc37-b605-4a37-9d0d-7149a4145ca4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:46.307336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526cc37-b605-4a37-9d0d-7149a4145ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:46.307605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526cc37-b605-4a37-9d0d-7149a4145ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:46.389268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8526cc37-b605-4a37-9d0d-7149a4145ca4 None None] MFA Rules not processed for user `d0233760befd4174814aeadb9a2d21e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:46.390876 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8526cc37-b605-4a37-9d0d-7149a4145ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:46.758356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1044/2055] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:46.758778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:46.758778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:46.790596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791fd7-01cd-4766-b63c-d1feeb593e84 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:46.828199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:46.828199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:46.828199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:46.828199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:46.828663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:46.828663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:46.839587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1012/2056] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:49.413362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89903e-bc23-42c0-b481-9f96fe62c04d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:49.413951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89903e-bc23-42c0-b481-9f96fe62c04d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:49.413951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89903e-bc23-42c0-b481-9f96fe62c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:49.435266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7a89903e-bc23-42c0-b481-9f96fe62c04d None None] MFA Rules not processed for user `fc1418800d0b4cf2b21ce9556f92e20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:49.437823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7a89903e-bc23-42c0-b481-9f96fe62c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:49.485563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:49.514202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1045/2057] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:50.723147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:50.723147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:50.881447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9940-74ed-48c6-97ce-013a136adcc5 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:50.892981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:50.893664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:50.894376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:50.894692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] PATH_INFO: `/v3/users/9c9175ce95ff485a902e28cf02992529` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:50.909119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9175ce95ff485a902e28cf02992529)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:50.911315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:50.946969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:51.247107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9175ce95ff485a902e28cf02992529'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:51.247891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9175ce95ff485a902e28cf02992529'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:51.256897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9175ce95ff485a902e28cf02992529'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:51.275478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9175ce95ff485a902e28cf02992529'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:51.276319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9175ce95ff485a902e28cf02992529'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:51.379617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1013/2058] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:50 2022] DELETE /identity/v3/users/9c9175ce95ff485a902e28cf02992529 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:51.384351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:51.384886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:51.384989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:51.419098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:51.421622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:51.502602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1046/2059] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:51.516236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:51.518020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:51.610420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6072ec-7032-4470-a055-4b83e695361c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:51.632740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3101e-2411-4f4b-bdc8-8990a84c85c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:51.635860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3101e-2411-4f4b-bdc8-8990a84c85c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:51.636528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3101e-2411-4f4b-bdc8-8990a84c85c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:51.645518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3101e-2411-4f4b-bdc8-8990a84c85c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:51.658000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:51.661917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:51.667472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3101e-2411-4f4b-bdc8-8990a84c85c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:51.668933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3101e-2411-4f4b-bdc8-8990a84c85c3 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:51.681858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1014/2060] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:51.704409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c25326-7f02-4ed0-b4f3-6d6ffbae531b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:51.728572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:51.729275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:51.729551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:51.729997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] PATH_INFO: `/v3/users/d0233760befd4174814aeadb9a2d21e5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:51.736104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0233760befd4174814aeadb9a2d21e5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:51.738603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:52.143897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0233760befd4174814aeadb9a2d21e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:52.154289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0233760befd4174814aeadb9a2d21e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:52.284964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0233760befd4174814aeadb9a2d21e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:52.325930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0233760befd4174814aeadb9a2d21e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:52.325930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0233760befd4174814aeadb9a2d21e5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:52.335916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1047/2061] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:51 2022] DELETE /identity/v3/users/d0233760befd4174814aeadb9a2d21e5 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:52.345008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:52.365304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:52.365304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:52.379687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:52.400103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:52.506582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:52.508052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:52.540139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1015/2062] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:52.582930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:52.584948 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:52.643034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7de96-de6b-4a6c-9033-de6de1c7f403 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:52.651229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:52.652050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:52.652423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:52.652855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] PATH_INFO: `/v3/projects/c6de28a57fac4f73892540a25d4bd354` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:52.655445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6de28a57fac4f73892540a25d4bd354)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:52.666170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:52.683376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:52.694856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:52.724204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3f067-d4c0-4b84-b442-4f349b60ef30 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:52.736727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:52.737398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:52.737683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:52.738761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:52.765398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:52.766173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:52.789576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1016/2063] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:39:52.878662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6de28a57fac4f73892540a25d4bd354', 'request_id': 'req-a02a2385-0680-4665-a10d-1860658b6d1e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:52.886898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6de28a57fac4f73892540a25d4bd354', 'request_id': 'req-a02a2385-0680-4665-a10d-1860658b6d1e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:52.892369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6de28a57fac4f73892540a25d4bd354', 'request_id': 'req-a02a2385-0680-4665-a10d-1860658b6d1e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.017238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] The token cache is being invalidate because project c6de28a57fac4f73892540a25d4bd354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:53.017898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.018772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.024722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1048/2064] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:52 2022] DELETE /identity/v3/projects/c6de28a57fac4f73892540a25d4bd354 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:53.029314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:53.051253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff10af9-3fce-4fb5-acc8-25831f1d7fbf service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:53.143318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:53.144378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:53.144860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:53.145528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] PATH_INFO: `/v3/users/34559d0c0b7e4f46b3d1aa40d4894215` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:53.148827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=34559d0c0b7e4f46b3d1aa40d4894215)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:53.158170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:53.422703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34559d0c0b7e4f46b3d1aa40d4894215'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.423360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34559d0c0b7e4f46b3d1aa40d4894215'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.432575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34559d0c0b7e4f46b3d1aa40d4894215'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.441552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:53.443150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:53.465223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2385-0680-4665-a10d-1860658b6d1e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:53.473093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34559d0c0b7e4f46b3d1aa40d4894215'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.474472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a99ceb36-636d-44fd-9ccc-1967458267dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34559d0c0b7e4f46b3d1aa40d4894215'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.475296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:53.476672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:53.476954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:53.478397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] PATH_INFO: `/v3/projects/802a0282efc04c02935310e6043958ac` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:53.480646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=802a0282efc04c02935310e6043958ac)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:53.484375 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:53.566755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1017/2065] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:39:53 2022] DELETE /identity/v3/users/34559d0c0b7e4f46b3d1aa40d4894215 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:53.673066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802a0282efc04c02935310e6043958ac', 'request_id': 'req-0b395072-b416-4e1a-b7fd-2faacdd4e108'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.680399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802a0282efc04c02935310e6043958ac', 'request_id': 'req-0b395072-b416-4e1a-b7fd-2faacdd4e108'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.691418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802a0282efc04c02935310e6043958ac', 'request_id': 'req-0b395072-b416-4e1a-b7fd-2faacdd4e108'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.790377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] The token cache is being invalidate because project 802a0282efc04c02935310e6043958ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:53.791026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.791915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-0b395072-b416-4e1a-b7fd-2faacdd4e108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:53.794737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1049/2066] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:53 2022] DELETE /identity/v3/projects/802a0282efc04c02935310e6043958ac => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:53.800335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4273d6-14c9-46df-9525-ce90badc44ae None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:53.801118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4273d6-14c9-46df-9525-ce90badc44ae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:53.801664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4273d6-14c9-46df-9525-ce90badc44ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:53.830216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0f4273d6-14c9-46df-9525-ce90badc44ae None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:53.832504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0f4273d6-14c9-46df-9525-ce90badc44ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:53.961509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1018/2067] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:53.963976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89b03-6374-4c9d-9eeb-136bfdddfb2a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:53.964269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89b03-6374-4c9d-9eeb-136bfdddfb2a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:53.964545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89b03-6374-4c9d-9eeb-136bfdddfb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.024916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3ad89b03-6374-4c9d-9eeb-136bfdddfb2a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:54.026911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3ad89b03-6374-4c9d-9eeb-136bfdddfb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:54.062154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1050/2068] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:54.063680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4273d6-14c9-46df-9525-ce90badc44ae None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:54.070446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:54.075200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4273d6-14c9-46df-9525-ce90badc44ae None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:54.080795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:54.082049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.082419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.082759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.083549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:54.083837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:54.085711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:54.113147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1019/2069] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:39:54.114619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89b03-6374-4c9d-9eeb-136bfdddfb2a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:54.127230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89b03-6374-4c9d-9eeb-136bfdddfb2a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:54.133975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:54.134602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.135552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.136169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.137340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:54.141840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:54.288026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1051/2070] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:54 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:54.291329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:54.318624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234526b-9db4-43e7-84fe-93af3be31239 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:54.360037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:54.366315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:54.448701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:54.450021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.450508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.450990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.452650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:54.455641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:54.499895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:54.523468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15deb6-0e65-4c9b-aae7-d8947f199400 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:54.532989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:54.534000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.534521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.535019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] PATH_INFO: `/v3/projects/582a9440e694448ab0146406d4ee9d08` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.542666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=582a9440e694448ab0146406d4ee9d08)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:54.545054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:54.572763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1020/2071] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:54 2022] POST /identity/v3/users => generated 288 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:54.573975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:54.598687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b6d5d-532d-4aba-ac20-4e62b9e8ffd4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:54.614218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:54.615102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.615479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.615867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.616662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:54.618535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:54.635293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1021/2072] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:54.640045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:54.653323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d74137-ee94-4c8c-bd5b-1b8ebd53d170 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:54.660637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:54.662527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.666838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.666838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.666838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:54.668048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:54.687682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1022/2073] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:54.698591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:54.714870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd39db-1c7b-44aa-bbcd-c45b22725454 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:54.736984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749d20-3a7a-4a2a-87f0-9ed4f9672995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:54.738811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749d20-3a7a-4a2a-87f0-9ed4f9672995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.739095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749d20-3a7a-4a2a-87f0-9ed4f9672995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.740848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749d20-3a7a-4a2a-87f0-9ed4f9672995 admin admin] PATH_INFO: `/v3/projects/25d00f65424541dbaad5ca0213deb017/users/86c47f4345b048be8bf5c12c4aad2c0d/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.779277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582a9440e694448ab0146406d4ee9d08', 'request_id': 'req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:54.786643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d749d20-3a7a-4a2a-87f0-9ed4f9672995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d00f65424541dbaad5ca0213deb017, user_id=86c47f4345b048be8bf5c12c4aad2c0d, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:54.789607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d749d20-3a7a-4a2a-87f0-9ed4f9672995 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:54.793182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582a9440e694448ab0146406d4ee9d08', 'request_id': 'req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:54.802616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582a9440e694448ab0146406d4ee9d08', 'request_id': 'req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:54.872175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1023/2074] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:54 2022] PUT /identity/v3/projects/25d00f65424541dbaad5ca0213deb017/users/86c47f4345b048be8bf5c12c4aad2c0d/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:54.883324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc406-379b-47a5-9d43-74bed08a956b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.883608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc406-379b-47a5-9d43-74bed08a956b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.883883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dc406-379b-47a5-9d43-74bed08a956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.928173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d97dc406-379b-47a5-9d43-74bed08a956b None None] MFA Rules not processed for user `86c47f4345b048be8bf5c12c4aad2c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:54.938899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d97dc406-379b-47a5-9d43-74bed08a956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:54.944776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] The token cache is being invalidate because project 582a9440e694448ab0146406d4ee9d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:39:54.945316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:54.947213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e1b4ef1a-9a0f-4abd-938b-cfe981b32eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:39:54.949445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1052/2075] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:39:54 2022] DELETE /identity/v3/projects/582a9440e694448ab0146406d4ee9d08 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:39:54.954673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504be21-169d-490b-a5a0-2c9807064d3d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:54.955881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504be21-169d-490b-a5a0-2c9807064d3d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:54.956427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504be21-169d-490b-a5a0-2c9807064d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:54.989820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0504be21-169d-490b-a5a0-2c9807064d3d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:55.011192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0504be21-169d-490b-a5a0-2c9807064d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:55.062392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1024/2076] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:55.110466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1053/2077] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:55.122252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:55.122643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:55.123020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:55.172150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:55.173480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:55.183330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1025/2078] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:55.187766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504be21-169d-490b-a5a0-2c9807064d3d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:55.202412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504be21-169d-490b-a5a0-2c9807064d3d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:55.204952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:55.205455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:55.206064 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:55.206391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:55.206662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:55.207268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:55.207400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:39:55.207668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:55.209335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:55.242048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:55.247793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1054/2079] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:39:55.260277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:55.294291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932d1f7-fba3-4574-b4a7-0eacb8465976 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:55.300109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:55.300864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:55.301181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:55.301525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:55.302154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:55.304102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:55.306944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207aba-dd07-4612-b031-f6af84285f3f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:55.310929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:55.312212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:55.312457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:55.313147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:55.326122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:55.327974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:55.337661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1026/2080] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:39:55.432454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:55.435227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1055/2081] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:55 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:55.456611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bab17-17ac-4aef-88b6-d55020afb25f service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:55.648399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:55.648667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:55.649356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:55.649639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:55.650720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:55.653715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:55.805752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:55.809159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1027/2082] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:55 2022] POST /identity/v3/users => generated 285 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:55.827535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0c05-bc97-4824-b9e2-d16ad795cb1b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:55.843960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:55.846455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:55.846907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:55.847326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:55.848951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:55.857305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:55.884951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1056/2083] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:39:55.889639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:55.912291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20067319-bed3-4f6a-80d3-93361920d208 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:55.944392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc5f51-c191-4ab6-9c73-deb32d231a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:55.946944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc5f51-c191-4ab6-9c73-deb32d231a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:55.946944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc5f51-c191-4ab6-9c73-deb32d231a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:55.946944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc5f51-c191-4ab6-9c73-deb32d231a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:55.946944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc5f51-c191-4ab6-9c73-deb32d231a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:55.949725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc5f51-c191-4ab6-9c73-deb32d231a7f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:56.006578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1028/2084] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:56.006672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:56.006672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed535f5f-6e63-4268-9d96-bd8a3ddc80f5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:56.020654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:56.021384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:56.021667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:56.021944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] PATH_INFO: `/v3/projects/3bdd735cec6c4dc19a62323bf22a13a5/users/e3674bd68b504812aa752de127daf54c/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:56.041462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bdd735cec6c4dc19a62323bf22a13a5, user_id=e3674bd68b504812aa752de127daf54c, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:56.044503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:56.198581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1057/2085] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:55 2022] PUT /identity/v3/projects/3bdd735cec6c4dc19a62323bf22a13a5/users/e3674bd68b504812aa752de127daf54c/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:56.210099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642de90-6651-408a-939c-3cae03b821e0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:56.210872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642de90-6651-408a-939c-3cae03b821e0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:56.211282 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642de90-6651-408a-939c-3cae03b821e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:56.307459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c642de90-6651-408a-939c-3cae03b821e0 None None] MFA Rules not processed for user `e3674bd68b504812aa752de127daf54c`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:56.307459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c642de90-6651-408a-939c-3cae03b821e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:56.466574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1029/2086] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:56.472530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:56.478564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:56.549933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaa576-da2d-43aa-81ab-876ec89a1330 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:56.555794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524396d-e16d-48f0-823a-3aa87dcf9d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:56.556451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524396d-e16d-48f0-823a-3aa87dcf9d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:56.556687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524396d-e16d-48f0-823a-3aa87dcf9d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:56.557083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524396d-e16d-48f0-823a-3aa87dcf9d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:56.557724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524396d-e16d-48f0-823a-3aa87dcf9d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:56.560036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524396d-e16d-48f0-823a-3aa87dcf9d00 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:56.693987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1058/2087] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:39:56 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:39:56.695248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642de90-6651-408a-939c-3cae03b821e0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:56.709915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642de90-6651-408a-939c-3cae03b821e0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:56.793282 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:56.869666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:56.869666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:56.869666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:56.869666 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:56.870019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:56.870019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:56.906518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:56.907066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:56.907160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:56.935395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:56.938028 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:56.969569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1030/2088] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:39:56 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:39:56.975399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:56.992013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21782b-208b-4285-83ce-b7f14579e893 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:57.018796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:57.019630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:57.020014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:57.020434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:57.021252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:57.023043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:57.041287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1031/2089] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:57.052903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:57.088721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a876718-354f-4335-9651-0c15472c5ae2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:57.094326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:57.095037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:57.095319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:57.095589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] PATH_INFO: `/v3/projects/0332eb2883a6432794d5f94cd0d0876c/users/f3107459d13048fb887f221c8d3cfb2b/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:57.109206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1059/2090] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:39:57.113706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0332eb2883a6432794d5f94cd0d0876c, user_id=f3107459d13048fb887f221c8d3cfb2b, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:57.116732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:57.128326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:57.129877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:57.215495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca713-9e1a-4104-8b1e-95ffc4bec53a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:57.216219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1032/2091] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:57 2022] PUT /identity/v3/projects/0332eb2883a6432794d5f94cd0d0876c/users/f3107459d13048fb887f221c8d3cfb2b/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:57.226179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:57.267648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:57.314844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed512-f4e9-403f-a7e5-b86105f060dc admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:57.318806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:57.319799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:57.320142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:57.320577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:57.321095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:57.321531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:57.321961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:57.322080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:57.322855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:57.325176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:57.343457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1033/2092] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:39:57.348495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:57.363584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644f488-201b-4907-ad33-011f97a3eaed admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:57.369719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb12c1-2e0a-4a8d-9078-0bb5ceb2857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:57.370634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb12c1-2e0a-4a8d-9078-0bb5ceb2857b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:57.370925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb12c1-2e0a-4a8d-9078-0bb5ceb2857b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:57.371686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb12c1-2e0a-4a8d-9078-0bb5ceb2857b admin admin] PATH_INFO: `/v3/projects/0332eb2883a6432794d5f94cd0d0876c/users/f3107459d13048fb887f221c8d3cfb2b/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:57.375008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb12c1-2e0a-4a8d-9078-0bb5ceb2857b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0332eb2883a6432794d5f94cd0d0876c, user_id=f3107459d13048fb887f221c8d3cfb2b, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:57.378748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb12c1-2e0a-4a8d-9078-0bb5ceb2857b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:57.405604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1034/2093] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:39:57 2022] PUT /identity/v3/projects/0332eb2883a6432794d5f94cd0d0876c/users/f3107459d13048fb887f221c8d3cfb2b/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:39:57.408267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62e636-ec47-42f4-8a0d-772ee62b3a9c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:57.408563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62e636-ec47-42f4-8a0d-772ee62b3a9c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:57.408838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62e636-ec47-42f4-8a0d-772ee62b3a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:57.424893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:57.429629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:57.449806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1060/2094] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:39:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 21:39:57.457165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5e62e636-ec47-42f4-8a0d-772ee62b3a9c None None] MFA Rules not processed for user `f3107459d13048fb887f221c8d3cfb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:39:57.458429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5e62e636-ec47-42f4-8a0d-772ee62b3a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:39:57.543956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:57.575930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1035/2095] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:39:57.592243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:39:57.694180 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c026-5feb-472b-aba8-8f550dddc3f9 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:39:57.818252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:39:57.818890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:39:57.819339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:39:57.819562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:39:57.830420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:39:57.857997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:39:57.874776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1061/2096] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:02.690632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a8bd-7966-47cd-b72e-0dde8e5dacfc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:02.690632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a8bd-7966-47cd-b72e-0dde8e5dacfc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:02.690632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a8bd-7966-47cd-b72e-0dde8e5dacfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:02.715456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7f07a8bd-7966-47cd-b72e-0dde8e5dacfc None None] MFA Rules not processed for user `30517a4b639c4a76a8f194f910c19720`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:02.716856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7f07a8bd-7966-47cd-b72e-0dde8e5dacfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:02.841798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1036/2097] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:03.100605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:03.252886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:03.364498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f2ec-cc71-44b0-85c5-4aa6c8e0eabc service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:03.380921 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:03.381741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:03.382026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:03.382350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] PATH_INFO: `/v3/users/e3674bd68b504812aa752de127daf54c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:03.385584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3674bd68b504812aa752de127daf54c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:03.389558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:03.632207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3674bd68b504812aa752de127daf54c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:03.664775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3674bd68b504812aa752de127daf54c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:03.756868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3674bd68b504812aa752de127daf54c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:03.777230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3674bd68b504812aa752de127daf54c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:03.779401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3674bd68b504812aa752de127daf54c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:03.806470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1062/2098] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:40:03 2022] DELETE /identity/v3/users/e3674bd68b504812aa752de127daf54c => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:03.813905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:03.814432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:03.814547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:03.842190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:03.854309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:04.018356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1037/2099] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:04.026516 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:04.029304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:04.175177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50da5-7131-423c-a544-01938574f536 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:04.183650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:04.184843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:04.185475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:04.185863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:04.204191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:04.210266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:04.254393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1063/2100] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:05.362549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:05.364860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:05.388326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7429a-1b8c-40f2-98d5-bb99f48baa10 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:05.420096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:05.421926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:05.424819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:05.425532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] PATH_INFO: `/v3/projects/3bdd735cec6c4dc19a62323bf22a13a5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:05.431859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bdd735cec6c4dc19a62323bf22a13a5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:05.436982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:05.644174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bdd735cec6c4dc19a62323bf22a13a5', 'request_id': 'req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:05.745816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bdd735cec6c4dc19a62323bf22a13a5', 'request_id': 'req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:05.753590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bdd735cec6c4dc19a62323bf22a13a5', 'request_id': 'req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:05.803229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] The token cache is being invalidate because project 3bdd735cec6c4dc19a62323bf22a13a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:40:05.803606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:05.804508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:05.806545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1038/2101] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:40:05 2022] DELETE /identity/v3/projects/3bdd735cec6c4dc19a62323bf22a13a5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:05.810578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:05.829915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc1252-a8d5-4286-b2ce-b30c53c726ab service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:05.989344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:05.991234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:05.994768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:05.998017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] PATH_INFO: `/v3/users/f3107459d13048fb887f221c8d3cfb2b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:06.008121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3107459d13048fb887f221c8d3cfb2b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:06.013676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:06.020497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:06.342928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3107459d13048fb887f221c8d3cfb2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:06.366267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3107459d13048fb887f221c8d3cfb2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:06.451725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3107459d13048fb887f221c8d3cfb2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:06.490309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3107459d13048fb887f221c8d3cfb2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:06.491627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-edfb29c4-9230-4fee-911a-3555492cda02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3107459d13048fb887f221c8d3cfb2b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:06.505748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1064/2102] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:40:05 2022] DELETE /identity/v3/users/f3107459d13048fb887f221c8d3cfb2b => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:07.291361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:07.293009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:07.312953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a440a7b-7750-4f65-ad1b-88dda2c29bd0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:07.361386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:07.448751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:07.449486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:07.449770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:07.450043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] PATH_INFO: `/v3/projects/0332eb2883a6432794d5f94cd0d0876c` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:07.458167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0332eb2883a6432794d5f94cd0d0876c)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:07.460177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:07.701402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0332eb2883a6432794d5f94cd0d0876c', 'request_id': 'req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:07.833834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0332eb2883a6432794d5f94cd0d0876c', 'request_id': 'req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:07.842411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0332eb2883a6432794d5f94cd0d0876c', 'request_id': 'req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:07.898305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] The token cache is being invalidate because project 0332eb2883a6432794d5f94cd0d0876c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:40:07.900636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:07.903682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dad99983-6d42-4dc2-bb33-ab5a6a419a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:07.913194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1039/2103] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:40:07 2022] DELETE /identity/v3/projects/0332eb2883a6432794d5f94cd0d0876c => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:07.919640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f680e7-e6ba-4b2c-af22-9e4d2b003336 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:07.920237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f680e7-e6ba-4b2c-af22-9e4d2b003336 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:07.920237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f680e7-e6ba-4b2c-af22-9e4d2b003336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:07.998558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-93f680e7-e6ba-4b2c-af22-9e4d2b003336 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:08.000679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-93f680e7-e6ba-4b2c-af22-9e4d2b003336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:08.118845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dea561-da16-4a1b-b6fc-798eed154d9b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.119145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dea561-da16-4a1b-b6fc-798eed154d9b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.119430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dea561-da16-4a1b-b6fc-798eed154d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.125808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1065/2104] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:08.150930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-80dea561-da16-4a1b-b6fc-798eed154d9b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:08.152045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-80dea561-da16-4a1b-b6fc-798eed154d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:08.166200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f680e7-e6ba-4b2c-af22-9e4d2b003336 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:08.174017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1040/2105] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:08.177768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f680e7-e6ba-4b2c-af22-9e4d2b003336 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:08.182906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:08.183553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.183828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.184089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.184742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:40:08.185059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:08.187572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:08.204673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1066/2106] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:40:08.210182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dea561-da16-4a1b-b6fc-798eed154d9b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:08.223216 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dea561-da16-4a1b-b6fc-798eed154d9b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:08.237277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:08.238244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.238591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.239013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.244709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:08.246964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:08.413156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1041/2107] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:40:08 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:40:08.414780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:08.427107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965bc50-a2a9-479e-8eec-2846096019ee admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:08.489696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:08.495458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.495701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.495983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.496640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:08.498777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:08.524239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:08.640502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1067/2108] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:40:08 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:40:08.642309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:08.658733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a4bd-937c-4804-8401-2aa5748be5a8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:08.669609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:08.670107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.670387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.670839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.671741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:08.673561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:08.702792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1042/2109] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:40:08.704255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:08.719175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7335fa-11da-4569-b9ff-11750a29b74b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:08.721825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1988e7-b402-4233-9bb0-f34d7e5adda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:08.722675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1988e7-b402-4233-9bb0-f34d7e5adda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.723092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1988e7-b402-4233-9bb0-f34d7e5adda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.723460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1988e7-b402-4233-9bb0-f34d7e5adda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.724335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1988e7-b402-4233-9bb0-f34d7e5adda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:08.726078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1988e7-b402-4233-9bb0-f34d7e5adda7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:08.743351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1068/2110] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:40:08.744986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:08.757544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1fa53-0ce5-4e1e-8940-6021989b2b90 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:08.762904 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:08.764832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.764832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.764832 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] PATH_INFO: `/v3/projects/9c04098a946c4a99b7b24ff98ef06588/users/77e70188c68047b8bae0c599004d625e/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.787779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c04098a946c4a99b7b24ff98ef06588, user_id=77e70188c68047b8bae0c599004d625e, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:08.791192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:08.886392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1043/2111] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:40:08 2022] PUT /identity/v3/projects/9c04098a946c4a99b7b24ff98ef06588/users/77e70188c68047b8bae0c599004d625e/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:08.898120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72ec4-de07-4378-bc01-1c4774ce26b9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:08.898434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72ec4-de07-4378-bc01-1c4774ce26b9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:08.898898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72ec4-de07-4378-bc01-1c4774ce26b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:08.977592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-71c72ec4-de07-4378-bc01-1c4774ce26b9 None None] MFA Rules not processed for user `77e70188c68047b8bae0c599004d625e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:08.979967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-71c72ec4-de07-4378-bc01-1c4774ce26b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:09.096517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1069/2112] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:09.100721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:09.223459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:09.275254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985feca-b8e1-4474-ada3-3fcacc010ed2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:09.281361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:09.282290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:09.283336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:09.283683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:09.284406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:09.286613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:09.386354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1044/2113] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:40:09 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:40:09.387481 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72ec4-de07-4378-bc01-1c4774ce26b9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:09.405403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72ec4-de07-4378-bc01-1c4774ce26b9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:09.545370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:09.548092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:09.548380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:09.548803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:09.549505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:09.551727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:09.661716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1070/2114] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:40:09 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:40:09.666098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:09.682241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90108e-4092-41ca-9edf-3e65ac656d06 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:09.690707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:09.691643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:09.692081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:09.692538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:09.693649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:09.695454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:09.723368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1045/2115] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:40:09.727935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:09.740863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934371a-821c-49d3-a588-9967abf8684d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:09.750890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:09.751823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:09.753313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:09.753762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] PATH_INFO: `/v3/projects/95291c6b0cd24c499f4e252fe836b218/users/9242b1a8e8d846cc9512d60723805dc9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:09.775637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95291c6b0cd24c499f4e252fe836b218, user_id=9242b1a8e8d846cc9512d60723805dc9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:09.778363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:09.847620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1071/2116] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:40:09 2022] PUT /identity/v3/projects/95291c6b0cd24c499f4e252fe836b218/users/9242b1a8e8d846cc9512d60723805dc9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:09.851482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:09.862439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8cc9c-747c-424d-8093-d67907663c5a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:10.052193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cd06b-c27c-4306-824d-b7f622193f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:10.052833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd06b-c27c-4306-824d-b7f622193f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:10.053258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd06b-c27c-4306-824d-b7f622193f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:10.056917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cd06b-c27c-4306-824d-b7f622193f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:10.056917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cd06b-c27c-4306-824d-b7f622193f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:10.056917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cd06b-c27c-4306-824d-b7f622193f0b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:10.082031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1046/2117] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:40:10.086761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:10.115711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8809a86-f49b-4319-bfe1-4d7e866df076 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:10.121380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6bc1c-cded-4870-a3c2-acd5a9fe25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:10.121705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6bc1c-cded-4870-a3c2-acd5a9fe25ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:10.121988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6bc1c-cded-4870-a3c2-acd5a9fe25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:10.133545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6bc1c-cded-4870-a3c2-acd5a9fe25ea admin admin] PATH_INFO: `/v3/projects/95291c6b0cd24c499f4e252fe836b218/users/9242b1a8e8d846cc9512d60723805dc9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:10.135899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6bc1c-cded-4870-a3c2-acd5a9fe25ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=95291c6b0cd24c499f4e252fe836b218, user_id=9242b1a8e8d846cc9512d60723805dc9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:10.139099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6bc1c-cded-4870-a3c2-acd5a9fe25ea admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:10.184055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1072/2118] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:40:10 2022] PUT /identity/v3/projects/95291c6b0cd24c499f4e252fe836b218/users/9242b1a8e8d846cc9512d60723805dc9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:40:10.188528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194ac14-0e92-46f1-8419-018658085442 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:10.188816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194ac14-0e92-46f1-8419-018658085442 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:10.189112 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194ac14-0e92-46f1-8419-018658085442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:10.258172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2194ac14-0e92-46f1-8419-018658085442 None None] MFA Rules not processed for user `9242b1a8e8d846cc9512d60723805dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:10.259434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2194ac14-0e92-46f1-8419-018658085442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:10.395054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:10.395336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:10.395742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:10.437793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1047/2119] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:10.451414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:10.451617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194ac14-0e92-46f1-8419-018658085442 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:10.455350 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2194ac14-0e92-46f1-8419-018658085442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:10.464184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:10.547539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:10.615725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:10.638503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194ac14-0e92-46f1-8419-018658085442 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:10.645297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:10.645919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:10.646357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:10.646515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:10.646756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1073/2120] 10.222.0.60 () {58 vars in 967 bytes} [Fri Sep 9 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:40:10.656967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:10.660267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:10.671846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1048/2121] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:40:10.684619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:10.686528 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:10.792686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f60ed-0f20-4277-9ed5-e636448d981d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:10.823377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:10.824851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:10.825168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:10.825442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:10.844118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:10.845787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:10.876176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1074/2122] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:40:11.455587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:11.456998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:11.497063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:11.498605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:11.511916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74fb19-6706-4dfb-b5c2-bb842b4a8532 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:11.516431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4efec9-e172-4996-bc4e-a187528e24e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:11.517089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4efec9-e172-4996-bc4e-a187528e24e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:11.517429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4efec9-e172-4996-bc4e-a187528e24e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:11.517725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4efec9-e172-4996-bc4e-a187528e24e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:11.525065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad32e90-1feb-4281-8d66-f5da04c3ca2b service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:11.529632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:11.530192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:11.530966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:11.531240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] PATH_INFO: `/v3/users/86c47f4345b048be8bf5c12c4aad2c0d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:11.532367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c47f4345b048be8bf5c12c4aad2c0d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:11.534327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:11.580453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4efec9-e172-4996-bc4e-a187528e24e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:11.581915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4efec9-e172-4996-bc4e-a187528e24e6 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:11.590813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1075/2123] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:40:11.849106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c47f4345b048be8bf5c12c4aad2c0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:11.854037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c47f4345b048be8bf5c12c4aad2c0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:11.862192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c47f4345b048be8bf5c12c4aad2c0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:11.890140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c47f4345b048be8bf5c12c4aad2c0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:11.891232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c47f4345b048be8bf5c12c4aad2c0d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:11.990270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1049/2124] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:40:11 2022] DELETE /identity/v3/users/86c47f4345b048be8bf5c12c4aad2c0d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:11.995250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:11.995605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:11.995908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:12.021077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:12.022337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:12.096931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:12.123012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:12.127099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:12.130063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1076/2125] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:12.213489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0802-747d-4920-b239-3f6fdae751a3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:12.219134 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fae1fc-058d-42ee-be7f-bbdd20480422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:12.224391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fae1fc-058d-42ee-be7f-bbdd20480422 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:12.224391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fae1fc-058d-42ee-be7f-bbdd20480422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:12.224391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fae1fc-058d-42ee-be7f-bbdd20480422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:12.232661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fae1fc-058d-42ee-be7f-bbdd20480422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:12.235100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fae1fc-058d-42ee-be7f-bbdd20480422 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:12.274583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1050/2126] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:12.941989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:12.943602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:12.958550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a3ab0-b136-4ed4-9761-a6bbf41b048d None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:12.965453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:12.965963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:12.966238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:12.966541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] PATH_INFO: `/v3/projects/25d00f65424541dbaad5ca0213deb017` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:12.967722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d00f65424541dbaad5ca0213deb017)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:12.969768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:13.142030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d00f65424541dbaad5ca0213deb017', 'request_id': 'req-359322c3-8c9d-464e-8026-4a6f29c4b124'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:13.153160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d00f65424541dbaad5ca0213deb017', 'request_id': 'req-359322c3-8c9d-464e-8026-4a6f29c4b124'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:13.169003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d00f65424541dbaad5ca0213deb017', 'request_id': 'req-359322c3-8c9d-464e-8026-4a6f29c4b124'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:13.589315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] The token cache is being invalidate because project 25d00f65424541dbaad5ca0213deb017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:40:13.589608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:13.590247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:13.591768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1077/2127] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:40:12 2022] DELETE /identity/v3/projects/25d00f65424541dbaad5ca0213deb017 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:15.578928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:15.579497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:15.579497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:15.601538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:15.602378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:15.603867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:15.668658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1051/2128] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:15.684442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:15.686895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:15.778244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359322c3-8c9d-464e-8026-4a6f29c4b124 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:15.784812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:15.785509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:15.785759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:15.786033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:15.795917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:15.798542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:15.825012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1078/2129] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:40:16.679846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:16.682181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:16.822307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257ab88-80a6-4a10-8255-9b361292bcc7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:16.829358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:16.830184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:16.830618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:16.831053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] PATH_INFO: `/v3/users/8f64d7d59a1d4736bc89abbb31508d46` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:16.832417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f64d7d59a1d4736bc89abbb31508d46)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:16.835763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:17.187889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f64d7d59a1d4736bc89abbb31508d46'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:17.188619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f64d7d59a1d4736bc89abbb31508d46'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:17.206613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f64d7d59a1d4736bc89abbb31508d46'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:17.222658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f64d7d59a1d4736bc89abbb31508d46'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:17.224063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f64d7d59a1d4736bc89abbb31508d46'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:17.326388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1052/2130] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:40:16 2022] DELETE /identity/v3/users/8f64d7d59a1d4736bc89abbb31508d46 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:17.894972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:17.901079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:17.903381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:17.919160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c3f48-9ee8-4231-9206-c4c6708e1224 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:18.000457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:18.036188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:18.037289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.038136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.038636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] PATH_INFO: `/v3/projects/5513f71ffc9441f3802273acb69fba3b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.040036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5513f71ffc9441f3802273acb69fba3b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:18.042227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:18.051260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8bc62-65a1-4ca5-8041-2254e43d88a6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:18.056623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:18.057308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.057637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.057922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] PATH_INFO: `/v3/users/77e70188c68047b8bae0c599004d625e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.059171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e70188c68047b8bae0c599004d625e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:18.062974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:18.089839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:18.230345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5513f71ffc9441f3802273acb69fba3b', 'request_id': 'req-17a6cbf2-a55a-440f-a323-649a079c6458'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.239871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5513f71ffc9441f3802273acb69fba3b', 'request_id': 'req-17a6cbf2-a55a-440f-a323-649a079c6458'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.248296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5513f71ffc9441f3802273acb69fba3b', 'request_id': 'req-17a6cbf2-a55a-440f-a323-649a079c6458'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.355098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] The token cache is being invalidate because project 5513f71ffc9441f3802273acb69fba3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:40:18.355378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.356560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-17a6cbf2-a55a-440f-a323-649a079c6458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.358392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1079/2131] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:40:17 2022] DELETE /identity/v3/projects/5513f71ffc9441f3802273acb69fba3b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:18.364662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775cd8-4d25-4882-8916-e4392fb1056a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.365352 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e70188c68047b8bae0c599004d625e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.366135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e70188c68047b8bae0c599004d625e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.366655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775cd8-4d25-4882-8916-e4392fb1056a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.368164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775cd8-4d25-4882-8916-e4392fb1056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.390716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e70188c68047b8bae0c599004d625e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.413637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e70188c68047b8bae0c599004d625e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.415960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-14451634-8c6d-4a3f-9c1d-b6d16b44c802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e70188c68047b8bae0c599004d625e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:18.437858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-90775cd8-4d25-4882-8916-e4392fb1056a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:18.439106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-90775cd8-4d25-4882-8916-e4392fb1056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:18.538201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1053/2132] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:40:17 2022] DELETE /identity/v3/users/77e70188c68047b8bae0c599004d625e => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:18.542428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.542928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.542928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.548606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1080/2133] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:18.556550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352ff4-ea4e-43f7-9479-955eae617c54 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.557124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352ff4-ea4e-43f7-9479-955eae617c54 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.557567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352ff4-ea4e-43f7-9479-955eae617c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.602421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:18.603704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:18.604524 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4d352ff4-ea4e-43f7-9479-955eae617c54 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:18.606478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4d352ff4-ea4e-43f7-9479-955eae617c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:18.713217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1081/2134] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:18.732045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d352ff4-ea4e-43f7-9479-955eae617c54 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:18.754278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d352ff4-ea4e-43f7-9479-955eae617c54 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:18.761710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1054/2135] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:18.770335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:18.771056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.771398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.771789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.772515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:40:18.772886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:18.774967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:18.776599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:18.782350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:18.814797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1082/2136] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:40:18.819278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:18.837235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e2fa2-8435-4641-8316-10f9598f2527 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:18.865418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:18.868325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.868608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.868901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.869557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:18.873521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:18.876744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633d9d6-b333-41ca-93ec-4b3c3c462490 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:18.883605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:18.890829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:18.890829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:18.890829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:18.901412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:18.903131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:18.930528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1055/2137] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:40:19.048469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1083/2138] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:40:18 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:40:19.052418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:19.065330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae3c25-d21d-4406-9c81-c2ce602e0459 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:19.081881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:19.236759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:19.239263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:19.239822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:19.241181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:19.243313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:19.250535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:19.364017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1056/2139] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:40:19 2022] POST /identity/v3/users => generated 285 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:40:19.364768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:19.383589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38fb4c-06ca-4ff7-9f6b-561f8654c984 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:19.389613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:19.391303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:19.391303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:19.394662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:19.395961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:19.399468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:19.404426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:19.426264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1084/2140] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:40:19.430177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:19.440877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ed42-6cdb-46de-a884-1c10f40a7881 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:19.454675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:19.455302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:19.455578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:19.455847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:19.456490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:19.458126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:19.494223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:19.503504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1057/2141] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:40:19.516817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bb09a-0c11-4b93-a348-2bac7e08e37c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:19.526333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0180da-fb29-447d-89ff-2cf341a15b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:19.527158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0180da-fb29-447d-89ff-2cf341a15b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:19.528102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0180da-fb29-447d-89ff-2cf341a15b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:19.528600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0180da-fb29-447d-89ff-2cf341a15b01 admin admin] PATH_INFO: `/v3/projects/0e89171ad493410cb091288c61e8d487/users/17aa44616cbf480ca607cb0369e7e8bd/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:19.554775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0180da-fb29-447d-89ff-2cf341a15b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e89171ad493410cb091288c61e8d487, user_id=17aa44616cbf480ca607cb0369e7e8bd, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:19.558796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0180da-fb29-447d-89ff-2cf341a15b01 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:19.684296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:19.691494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1085/2142] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:40:19 2022] PUT /identity/v3/projects/0e89171ad493410cb091288c61e8d487/users/17aa44616cbf480ca607cb0369e7e8bd/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:19.692783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:19.694368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:19.694783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:19.695199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:19.712342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822705f6-d0cc-4f3c-9d07-6d615ef564fb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:19.753834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] MFA Rules not processed for user `17aa44616cbf480ca607cb0369e7e8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:19.755308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:19.821473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:19.822283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:19.822662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:19.823080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] PATH_INFO: `/v3/projects/9c04098a946c4a99b7b24ff98ef06588` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:19.824388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c04098a946c4a99b7b24ff98ef06588)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:19.827260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:19.859734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1086/2143] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:19.881296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:19.883871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:19.987697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c04098a946c4a99b7b24ff98ef06588', 'request_id': 'req-afd611e3-9c46-4a96-a887-78dd2da7621f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.011362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a38f24-f348-4693-be68-cc3ee024a162 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:20.065990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c04098a946c4a99b7b24ff98ef06588', 'request_id': 'req-afd611e3-9c46-4a96-a887-78dd2da7621f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.073871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c04098a946c4a99b7b24ff98ef06588', 'request_id': 'req-afd611e3-9c46-4a96-a887-78dd2da7621f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.093290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] The token cache is being invalidate because project 9c04098a946c4a99b7b24ff98ef06588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:40:20.093857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.095233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.097613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1058/2144] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:40:19 2022] DELETE /identity/v3/projects/9c04098a946c4a99b7b24ff98ef06588 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:20.101681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:20.103940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:20.110622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:20.118530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:20.119170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:20.122695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:20.122985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:20.128295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:20.197432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:20.225870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd611e3-9c46-4a96-a887-78dd2da7621f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:20.235353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:20.238716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:20.244850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:20.244850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] PATH_INFO: `/v3/users/9242b1a8e8d846cc9512d60723805dc9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:20.244850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9242b1a8e8d846cc9512d60723805dc9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:20.244850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:20.259390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:20.262322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:20.297134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1087/2145] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:20.510800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9242b1a8e8d846cc9512d60723805dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.511576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9242b1a8e8d846cc9512d60723805dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.531946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9242b1a8e8d846cc9512d60723805dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.556314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9242b1a8e8d846cc9512d60723805dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.557205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-981a06e7-0c3d-4f96-a6df-644ec68e7f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9242b1a8e8d846cc9512d60723805dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:20.631889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1059/2146] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:40:20 2022] DELETE /identity/v3/users/9242b1a8e8d846cc9512d60723805dc9 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:40:21.460936 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:21.473721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceb898-90d3-49dd-8c43-e405288c562b service glance] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:21.571153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:21.571885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:21.572366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:21.585282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] PATH_INFO: `/v3/projects/95291c6b0cd24c499f4e252fe836b218` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:21.588316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95291c6b0cd24c499f4e252fe836b218)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:21.590324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:21.764890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95291c6b0cd24c499f4e252fe836b218', 'request_id': 'req-d85939d9-e20e-4f80-9572-a294589c173e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:21.783439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95291c6b0cd24c499f4e252fe836b218', 'request_id': 'req-d85939d9-e20e-4f80-9572-a294589c173e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:21.795734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95291c6b0cd24c499f4e252fe836b218', 'request_id': 'req-d85939d9-e20e-4f80-9572-a294589c173e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:21.874369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] The token cache is being invalidate because project 95291c6b0cd24c499f4e252fe836b218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:40:21.875955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:21.877574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d85939d9-e20e-4f80-9572-a294589c173e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:21.880890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1088/2147] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:40:21 2022] DELETE /identity/v3/projects/95291c6b0cd24c499f4e252fe836b218 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:21.887706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc59ef-3170-4170-98cc-a86e5962029b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:21.889220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc59ef-3170-4170-98cc-a86e5962029b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:21.889658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc59ef-3170-4170-98cc-a86e5962029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:21.917330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-92fc59ef-3170-4170-98cc-a86e5962029b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:21.919226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-92fc59ef-3170-4170-98cc-a86e5962029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:22.061565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1060/2148] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:22.070582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b82c3-7be5-445c-a890-8bb2f61df930 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.070998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b82c3-7be5-445c-a890-8bb2f61df930 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.074533 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b82c3-7be5-445c-a890-8bb2f61df930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.111423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f35b82c3-7be5-445c-a890-8bb2f61df930 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:22.112699 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f35b82c3-7be5-445c-a890-8bb2f61df930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:22.120873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1089/2149] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:22.125547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc59ef-3170-4170-98cc-a86e5962029b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:22.139036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc59ef-3170-4170-98cc-a86e5962029b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:22.144883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:22.145543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.145820 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.146089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.146767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:40:22.147128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:22.149000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:22.170285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1061/2150] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:40:22.175529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b82c3-7be5-445c-a890-8bb2f61df930 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:22.186280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b82c3-7be5-445c-a890-8bb2f61df930 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:22.193536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:22.194298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.194684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.195061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.196076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:22.198251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:22.317804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1090/2151] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:40:22 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:40:22.322069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:22.332410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b23c5b-9edb-4888-8834-0adfdb239766 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:22.338328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:22.422554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:22.423260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.423649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.424885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.425441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:22.427801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:22.540109 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1062/2152] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:40:22 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:40:22.550637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:22.563855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1093-e00f-49a1-8618-5310c0b60968 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:22.574034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:22.583085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.583085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.583085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.583085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:22.583085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:22.600878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1091/2153] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:40:22.605193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:22.620063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8849ac-d8ef-4f7a-9d79-e82ec3f2407d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:22.626264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6525eb-a557-4780-a087-432119c10799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:22.627166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6525eb-a557-4780-a087-432119c10799 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.627449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6525eb-a557-4780-a087-432119c10799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.627720 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6525eb-a557-4780-a087-432119c10799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.628435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6525eb-a557-4780-a087-432119c10799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:22.630224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6525eb-a557-4780-a087-432119c10799 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:22.645078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1063/2154] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:40:22.647928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:22.659485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012ec6f-13f6-4c7c-ac3b-c5931978c574 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:22.665165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:22.669087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.669087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.669087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] PATH_INFO: `/v3/projects/3229e2d0d6d04b3bb1a559ffe960bde9/users/862afadb173d4f2bbc22b0aaf31a6b15/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.687873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3229e2d0d6d04b3bb1a559ffe960bde9, user_id=862afadb173d4f2bbc22b0aaf31a6b15, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:22.690971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:22.781772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:22.789798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1092/2155] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:40:22 2022] PUT /identity/v3/projects/3229e2d0d6d04b3bb1a559ffe960bde9/users/862afadb173d4f2bbc22b0aaf31a6b15/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:22.802263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:22.802820 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:22.803243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:22.902401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] MFA Rules not processed for user `862afadb173d4f2bbc22b0aaf31a6b15`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:22.903766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:23.003810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1064/2156] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:29.941292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:29.943119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:30.006981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceadab-e0cc-4e4b-afb9-e2d6ef3a537e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:30.011282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b0c80-0a8c-476f-a90d-6946046b8b69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:30.011999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b0c80-0a8c-476f-a90d-6946046b8b69 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:30.012277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b0c80-0a8c-476f-a90d-6946046b8b69 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:30.012548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b0c80-0a8c-476f-a90d-6946046b8b69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:30.021846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b0c80-0a8c-476f-a90d-6946046b8b69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:30.023468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b0c80-0a8c-476f-a90d-6946046b8b69 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:30.033452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1093/2157] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:40:31.075092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:31.077077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:31.141497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5b89f-e448-4d83-8a11-3b87bf8b33a5 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:31.145068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5eb61-d19b-4be2-bab9-dba3ba27011d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:31.145665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5eb61-d19b-4be2-bab9-dba3ba27011d service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:31.145970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5eb61-d19b-4be2-bab9-dba3ba27011d service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:31.146281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5eb61-d19b-4be2-bab9-dba3ba27011d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:31.148003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-16f5eb61-d19b-4be2-bab9-dba3ba27011d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:31.182975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:31.218222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5eb61-d19b-4be2-bab9-dba3ba27011d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:31.220574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5eb61-d19b-4be2-bab9-dba3ba27011d service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:31.231499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1065/2158] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:37.280544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56a4a-e9b4-4da5-b4bd-c6bb2b9fda54 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.281004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56a4a-e9b4-4da5-b4bd-c6bb2b9fda54 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.281323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56a4a-e9b4-4da5-b4bd-c6bb2b9fda54 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.282857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1094/2159] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:40:37.289134 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44fb4-6a54-4756-8481-e67337cbf8f3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.290000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44fb4-6a54-4756-8481-e67337cbf8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.290463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44fb4-6a54-4756-8481-e67337cbf8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.316525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-36e44fb4-6a54-4756-8481-e67337cbf8f3 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:37.319559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-36e44fb4-6a54-4756-8481-e67337cbf8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:37.393879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1066/2160] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:37.406060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56a4a-e9b4-4da5-b4bd-c6bb2b9fda54 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:37.407934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b2f56a4a-e9b4-4da5-b4bd-c6bb2b9fda54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:37.421757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56a4a-e9b4-4da5-b4bd-c6bb2b9fda54 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:37.426026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd242a6-502d-4212-a2ec-3433e0d2e717 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:37.426633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd242a6-502d-4212-a2ec-3433e0d2e717 service glance] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.427123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd242a6-502d-4212-a2ec-3433e0d2e717 service glance] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.427399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd242a6-502d-4212-a2ec-3433e0d2e717 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.437651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd242a6-502d-4212-a2ec-3433e0d2e717 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:37.439788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd242a6-502d-4212-a2ec-3433e0d2e717 service glance] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:37.451217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1095/2161] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:37.697025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e9a1-6465-4772-a9b4-9fc16b372e97 None None] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.697333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e9a1-6465-4772-a9b4-9fc16b372e97 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.697611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e9a1-6465-4772-a9b4-9fc16b372e97 None None] PATH_INFO: `/` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.698956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1067/2162] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:40:37.703937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9426a3-cee2-4a9b-ac59-8b0b788da6b1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.704223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9426a3-cee2-4a9b-ac59-8b0b788da6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.704495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9426a3-cee2-4a9b-ac59-8b0b788da6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.726462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8c9426a3-cee2-4a9b-ac59-8b0b788da6b1 None None] MFA Rules not processed for user `cf39db40dace49cbba29c0596cbe76bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:37.727685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c9426a3-cee2-4a9b-ac59-8b0b788da6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:37.734223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1096/2163] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:37.748489 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763e9a1-6465-4772-a9b4-9fc16b372e97 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:37.750325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f763e9a1-6465-4772-a9b4-9fc16b372e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:37.765294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763e9a1-6465-4772-a9b4-9fc16b372e97 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:37.769615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287e01b-d486-456f-948b-7c87a830471d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:37.770399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287e01b-d486-456f-948b-7c87a830471d service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.770711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287e01b-d486-456f-948b-7c87a830471d service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.770989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287e01b-d486-456f-948b-7c87a830471d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.779083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287e01b-d486-456f-948b-7c87a830471d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:37.780513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287e01b-d486-456f-948b-7c87a830471d service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:37.791565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1068/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:37.890029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1870c5-8afb-4bb4-b375-805db54f3aed None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.890412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1870c5-8afb-4bb4-b375-805db54f3aed None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.890763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1870c5-8afb-4bb4-b375-805db54f3aed None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.892226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1097/2165] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:40:37.897577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3171bb-b771-4705-902f-bae63ad297b9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.897864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3171bb-b771-4705-902f-bae63ad297b9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.898138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3171bb-b771-4705-902f-bae63ad297b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.919381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bd3171bb-b771-4705-902f-bae63ad297b9 None None] MFA Rules not processed for user `97eb6832e7d246d6b6f1813763ac8a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:37.920596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bd3171bb-b771-4705-902f-bae63ad297b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:37.931096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1069/2166] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:37.943755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1870c5-8afb-4bb4-b375-805db54f3aed None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:37.955240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1870c5-8afb-4bb4-b375-805db54f3aed None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:37.959895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:37.960523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:37.960804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:37.961114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:37.974944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:37.976419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:37.989245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1098/2167] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:46.151225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:46.151225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:46.151225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:46.172960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:46.174324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:46.242886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1070/2168] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:40:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:46.271622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:46.273346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:46.359022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b59da4-f75a-4fb0-9419-878ee37dc061 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:46.364253 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8a6f-1a8d-45e8-b1e1-1fa681aa9dfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:46.364869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8a6f-1a8d-45e8-b1e1-1fa681aa9dfc service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:46.365182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8a6f-1a8d-45e8-b1e1-1fa681aa9dfc service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:46.365482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8a6f-1a8d-45e8-b1e1-1fa681aa9dfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:46.373681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf8a6f-1a8d-45e8-b1e1-1fa681aa9dfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:46.375278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf8a6f-1a8d-45e8-b1e1-1fa681aa9dfc service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:46.384475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1099/2169] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:40:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:40:51.384231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:51.386200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:51.442555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:51.462021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dafc4c-9593-4a9f-956c-7aec13792a06 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:51.466431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:51.474402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:51.474402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:51.474402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] PATH_INFO: `/v3/users/17aa44616cbf480ca607cb0369e7e8bd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:51.474402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17aa44616cbf480ca607cb0369e7e8bd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:51.474402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:51.707138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17aa44616cbf480ca607cb0369e7e8bd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:51.707998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17aa44616cbf480ca607cb0369e7e8bd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:51.715429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17aa44616cbf480ca607cb0369e7e8bd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:51.730556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17aa44616cbf480ca607cb0369e7e8bd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:51.731925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17aa44616cbf480ca607cb0369e7e8bd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:51.823410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1071/2170] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:40:51 2022] DELETE /identity/v3/users/17aa44616cbf480ca607cb0369e7e8bd => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:51.828161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:51.828703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:51.828703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:51.849241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:51.851053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:51.911381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:51.920066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1100/2171] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:40:51.930761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:51.932391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:52.018289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422d88-8221-4d82-9316-2d0aca054605 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:52.036338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac9295-5656-4e96-be1a-a51307d72a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:52.037544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac9295-5656-4e96-be1a-a51307d72a1c service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:52.038127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac9295-5656-4e96-be1a-a51307d72a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:52.039646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac9295-5656-4e96-be1a-a51307d72a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:52.060190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac9295-5656-4e96-be1a-a51307d72a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:52.063486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac9295-5656-4e96-be1a-a51307d72a1c service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:52.086114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1072/2172] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:40:52.630279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:40:52.631852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:52.645781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b8995-5774-480d-a4a5-ded491995650 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:40:52.651864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:40:52.652610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:52.652974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:52.653336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] PATH_INFO: `/v3/projects/0e89171ad493410cb091288c61e8d487` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:52.658905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e89171ad493410cb091288c61e8d487)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:40:52.658905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:40:52.790750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e89171ad493410cb091288c61e8d487', 'request_id': 'req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:52.797015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e89171ad493410cb091288c61e8d487', 'request_id': 'req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:52.804529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e89171ad493410cb091288c61e8d487', 'request_id': 'req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:52.908333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] The token cache is being invalidate because project 0e89171ad493410cb091288c61e8d487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:40:52.908991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:52.909415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:40:52.911146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1101/2173] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:40:52 2022] DELETE /identity/v3/projects/0e89171ad493410cb091288c61e8d487 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:40:53.061449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:40:53.062356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:40:53.062792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:40:53.086641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] MFA Rules not processed for user `3ecfea42ece24ef095287d27dd752cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:40:53.089953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:40:53.148180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1073/2174] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:41:01.286878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:41:01.288303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:01.367570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef5e25-4113-4e8c-acdf-6cd9b2d9fcc1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:41:01.373808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5121c-3699-41de-aae2-7cd97aa17788 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:41:01.374432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5121c-3699-41de-aae2-7cd97aa17788 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:01.375171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5121c-3699-41de-aae2-7cd97aa17788 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:01.375171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5121c-3699-41de-aae2-7cd97aa17788 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:01.376719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d4f5121c-3699-41de-aae2-7cd97aa17788 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:01.391519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5121c-3699-41de-aae2-7cd97aa17788 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:41:01.393931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5121c-3699-41de-aae2-7cd97aa17788 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:41:01.407872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1102/2175] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:41:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:41:03.140073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:04.051009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:41:04.052640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:04.123380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b124304-216c-45f9-91f0-51658c1094dd None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:41:04.127920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:41:04.128556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:04.128837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:04.129141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] PATH_INFO: `/v3/users/862afadb173d4f2bbc22b0aaf31a6b15` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:04.130322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] RBAC: Authorizing `identity:delete_user(user_id=862afadb173d4f2bbc22b0aaf31a6b15)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:41:04.133185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:41:04.369847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862afadb173d4f2bbc22b0aaf31a6b15'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:04.370467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862afadb173d4f2bbc22b0aaf31a6b15'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:04.378635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862afadb173d4f2bbc22b0aaf31a6b15'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:04.392592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862afadb173d4f2bbc22b0aaf31a6b15'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:04.393483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862afadb173d4f2bbc22b0aaf31a6b15'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:04.481111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1074/2176] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:41:04 2022] DELETE /identity/v3/users/862afadb173d4f2bbc22b0aaf31a6b15 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:41:04.485826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:04.486308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:04.486412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:04.505509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:41:04.507450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:04.566257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1103/2177] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:41:04.577894 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:41:04.579709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:04.638592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ae59e-45c6-4593-897d-cbe53395981b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:41:04.642164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31545b4-bba6-4163-93a7-16859d737141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:41:04.642769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31545b4-bba6-4163-93a7-16859d737141 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:04.643049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31545b4-bba6-4163-93a7-16859d737141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:04.643324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31545b4-bba6-4163-93a7-16859d737141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:04.652247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31545b4-bba6-4163-93a7-16859d737141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:41:04.653718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31545b4-bba6-4163-93a7-16859d737141 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:41:04.663412 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1075/2178] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:41:05.151189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:41:05.152651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:05.167920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30d7a1-446b-42bd-a7ce-826afc3d4adf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:41:05.173412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:41:05.174638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:05.174950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:05.175254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] PATH_INFO: `/v3/projects/3229e2d0d6d04b3bb1a559ffe960bde9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:05.176369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3229e2d0d6d04b3bb1a559ffe960bde9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:41:05.179107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:41:05.187629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:05.299301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3229e2d0d6d04b3bb1a559ffe960bde9', 'request_id': 'req-224deb14-cbad-4017-b3de-cc1a1e78182e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:05.305488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3229e2d0d6d04b3bb1a559ffe960bde9', 'request_id': 'req-224deb14-cbad-4017-b3de-cc1a1e78182e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:05.312105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3229e2d0d6d04b3bb1a559ffe960bde9', 'request_id': 'req-224deb14-cbad-4017-b3de-cc1a1e78182e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:05.406037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] The token cache is being invalidate because project 3229e2d0d6d04b3bb1a559ffe960bde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:41:05.406244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:05.406864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:41:05.408400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1104/2179] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:41:05 2022] DELETE /identity/v3/projects/3229e2d0d6d04b3bb1a559ffe960bde9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:41:08.650862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b2b2-1c39-47c3-8065-440f34ef21f2 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:08.651333 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b2b2-1c39-47c3-8065-440f34ef21f2 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:08.651425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b2b2-1c39-47c3-8065-440f34ef21f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:08.670785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f144b2b2-1c39-47c3-8065-440f34ef21f2 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:41:08.671986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f144b2b2-1c39-47c3-8065-440f34ef21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:08.694807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:08.731760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1076/2180] 10.222.0.60 () {58 vars in 967 bytes} [Fri Sep 9 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:41:08.744595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:41:08.746181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:08.819935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224deb14-cbad-4017-b3de-cc1a1e78182e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:41:08.826163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedef4c3-b76c-4af8-a87e-c28cb2e30868 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:41:08.826865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef4c3-b76c-4af8-a87e-c28cb2e30868 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:08.827143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef4c3-b76c-4af8-a87e-c28cb2e30868 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:08.827413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedef4c3-b76c-4af8-a87e-c28cb2e30868 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:08.836410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedef4c3-b76c-4af8-a87e-c28cb2e30868 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:41:08.838029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedef4c3-b76c-4af8-a87e-c28cb2e30868 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:41:08.847202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1105/2181] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:41:18.789234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=15 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:18.842959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:45.678830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6cc7d-3982-42a1-b4ad-286f2167dce8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:41:45.682730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6cc7d-3982-42a1-b4ad-286f2167dce8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:41:45.682730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6cc7d-3982-42a1-b4ad-286f2167dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:41:45.699500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-02f6cc7d-3982-42a1-b4ad-286f2167dce8 None None] MFA Rules not processed for user `30517a4b639c4a76a8f194f910c19720`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:41:45.700732 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-02f6cc7d-3982-42a1-b4ad-286f2167dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:41:45.755023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1077/2182] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:41:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:41:55.748468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=25 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:03.690928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98942-07f0-42f6-92b0-10e6f307fb3e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:03.693489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98942-07f0-42f6-92b0-10e6f307fb3e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:03.693489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98942-07f0-42f6-92b0-10e6f307fb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:03.710131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dec98942-07f0-42f6-92b0-10e6f307fb3e None None] MFA Rules not processed for user `419c0e2718cd4140b07cf0c92a18c296`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:42:03.711326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dec98942-07f0-42f6-92b0-10e6f307fb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:03.772443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1106/2183] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:42:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:42:13.765141 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=25 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:25.879759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4413-40aa-4c98-acdb-8383ef886a56 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:25.880223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4413-40aa-4c98-acdb-8383ef886a56 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:25.880326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4413-40aa-4c98-acdb-8383ef886a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:25.900661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d04b4413-40aa-4c98-acdb-8383ef886a56 None None] MFA Rules not processed for user `3ecfea42ece24ef095287d27dd752cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:42:25.902218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d04b4413-40aa-4c98-acdb-8383ef886a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:25.959081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1078/2184] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:42:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:42:26.543433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ad2e-0c32-4867-a1a1-6e1aa3c3cc1c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:26.544012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ad2e-0c32-4867-a1a1-6e1aa3c3cc1c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:26.544012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ad2e-0c32-4867-a1a1-6e1aa3c3cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:26.563457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b3c5ad2e-0c32-4867-a1a1-6e1aa3c3cc1c None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:42:26.564666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b3c5ad2e-0c32-4867-a1a1-6e1aa3c3cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:26.573700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1107/2185] 10.222.0.60 () {58 vars in 967 bytes} [Fri Sep 9 21:42:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:42:26.698500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4413-40aa-4c98-acdb-8383ef886a56 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:26.710855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4413-40aa-4c98-acdb-8383ef886a56 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:26.715955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de7bc1-b7e4-4c6e-a6c5-29fb60e59145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:26.716564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de7bc1-b7e4-4c6e-a6c5-29fb60e59145 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:26.716845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de7bc1-b7e4-4c6e-a6c5-29fb60e59145 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:26.717161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de7bc1-b7e4-4c6e-a6c5-29fb60e59145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:26.727022 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de7bc1-b7e4-4c6e-a6c5-29fb60e59145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:26.728766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de7bc1-b7e4-4c6e-a6c5-29fb60e59145 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:26.738055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1079/2186] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:31.963625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beb98-ec9b-4b84-99ea-cb6d0c8cbd93 None None] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:31.964545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beb98-ec9b-4b84-99ea-cb6d0c8cbd93 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:31.964831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beb98-ec9b-4b84-99ea-cb6d0c8cbd93 None None] PATH_INFO: `/` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:31.966407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1108/2187] 10.222.0.60 () {54 vars in 921 bytes} [Fri Sep 9 21:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:42:32.033782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647caf3-980b-4dcc-a516-881944075fba None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:32.034717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647caf3-980b-4dcc-a516-881944075fba None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:32.035151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647caf3-980b-4dcc-a516-881944075fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:32.065967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-7647caf3-980b-4dcc-a516-881944075fba None None] MFA Rules not processed for user `fa725c2a086f4964acefdadb45cc88ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:42:32.067299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7647caf3-980b-4dcc-a516-881944075fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:32.159552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1080/2188] 10.222.0.60 () {58 vars in 1018 bytes} [Fri Sep 9 21:42:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:42:32.189738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215beb98-ec9b-4b84-99ea-cb6d0c8cbd93 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:32.190656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-215beb98-ec9b-4b84-99ea-cb6d0c8cbd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:32.210830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215beb98-ec9b-4b84-99ea-cb6d0c8cbd93 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:32.216807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:32.218508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:32.219278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:32.219770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:32.229370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:32.231056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:32.243691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1109/2189] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:42:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:42:36.018968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647caf3-980b-4dcc-a516-881944075fba None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:36.021564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7647caf3-980b-4dcc-a516-881944075fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:36.117782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647caf3-980b-4dcc-a516-881944075fba None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:36.123048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:36.124252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:36.124531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:36.124996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] PATH_INFO: `/v3/users/fc1418800d0b4cf2b21ce9556f92e20e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:36.126375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1418800d0b4cf2b21ce9556f92e20e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:36.128317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:36.284710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:36.300588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1418800d0b4cf2b21ce9556f92e20e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:36.302140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1418800d0b4cf2b21ce9556f92e20e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:36.311141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1418800d0b4cf2b21ce9556f92e20e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:36.325249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1418800d0b4cf2b21ce9556f92e20e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:36.326245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1418800d0b4cf2b21ce9556f92e20e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:36.393171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1081/2190] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:42:36 2022] DELETE /identity/v3/users/fc1418800d0b4cf2b21ce9556f92e20e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:42:36.696099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:36.709411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d50c0-75da-49fe-8681-ec32e9aa7978 service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:36.776721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:36.783848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:36.783848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:36.783848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] PATH_INFO: `/v3/projects/d4b054624cc4432fbed995dce074e139` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:36.783848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b054624cc4432fbed995dce074e139)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:36.783848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:36.921237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b054624cc4432fbed995dce074e139', 'request_id': 'req-e97e7da1-c81d-4201-82e2-198a7b33f528'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:36.926940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b054624cc4432fbed995dce074e139', 'request_id': 'req-e97e7da1-c81d-4201-82e2-198a7b33f528'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:36.933319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b054624cc4432fbed995dce074e139', 'request_id': 'req-e97e7da1-c81d-4201-82e2-198a7b33f528'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.015504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] The token cache is being invalidate because project d4b054624cc4432fbed995dce074e139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:42:37.015720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.016313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.017838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1110/2191] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:42:36 2022] DELETE /identity/v3/projects/d4b054624cc4432fbed995dce074e139 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:42:37.021969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:37.023395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:37.036906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f3df3-a64f-4cdb-9681-c74bb2d1f493 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:37.101891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:37.102540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:37.102822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:37.103119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] PATH_INFO: `/v3/users/a7eb4fba8f2840d190b478251a84b023` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:37.104265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7eb4fba8f2840d190b478251a84b023)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:37.106286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:37.323682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7eb4fba8f2840d190b478251a84b023'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.324457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7eb4fba8f2840d190b478251a84b023'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.331903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7eb4fba8f2840d190b478251a84b023'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.345723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7eb4fba8f2840d190b478251a84b023'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.346643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-181f2685-24d4-4ee5-8c78-4677ddbb0cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7eb4fba8f2840d190b478251a84b023'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.432026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1082/2192] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:42:37 2022] DELETE /identity/v3/users/a7eb4fba8f2840d190b478251a84b023 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:42:37.691491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:37.692892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:37.708565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7da1-c81d-4201-82e2-198a7b33f528 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:37.767623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:37.768249 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:37.768523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:37.768790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] PATH_INFO: `/v3/projects/f03df1112ed749869890525997db4717` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:37.769923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03df1112ed749869890525997db4717)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:37.771807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:37.782728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:37.923436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03df1112ed749869890525997db4717', 'request_id': 'req-435186b7-5d76-4f81-8cb5-101497642ed5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.928887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03df1112ed749869890525997db4717', 'request_id': 'req-435186b7-5d76-4f81-8cb5-101497642ed5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:37.935120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03df1112ed749869890525997db4717', 'request_id': 'req-435186b7-5d76-4f81-8cb5-101497642ed5'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:38.013902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] The token cache is being invalidate because project f03df1112ed749869890525997db4717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:42:38.014286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:38.015591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-435186b7-5d76-4f81-8cb5-101497642ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:42:38.017119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1111/2193] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:42:37 2022] DELETE /identity/v3/projects/f03df1112ed749869890525997db4717 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:42:41.652748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:41.653329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:41.653329 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:41.673896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] MFA Rules not processed for user `47091634f81746e7b68d3e78746e2f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:42:41.677569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:41.695675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:41.733654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1083/2194] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:42:48.010700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:51.838159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=13 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:55.170594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:55.171067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:55.171160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:55.191042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] MFA Rules not processed for user `30517a4b639c4a76a8f194f910c19720`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:42:55.192227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:55.247164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1112/2195] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:42:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:42:55.285830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:55.287217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:55.344733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2414472-9544-4d1a-bac1-cc155425de79 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:55.348476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d284f9dd17546208bc48aa269c56fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:55.349102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:55.349382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:55.349650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:55.351427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:55.422655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:55.424043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:55.434935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1084/2196] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:42:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:42:57.018202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:42:57.019787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:57.078594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000a0b9-2f21-4342-88ae-388aa7119896 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:42:57.083428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:42:57.084051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:42:57.084328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:42:57.084599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:42:57.086371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:42:57.100634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:42:57.102086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:42:57.113048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1113/2197] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:42:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:05.429963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=54 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:05.648418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:05.650252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:05.664426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012f86f-a4f1-4ce6-af38-d88132433c8d service glance] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:05.670523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:05.671144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:05.671430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:05.671707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:05.673969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:05.687866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:05.690424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:05.701188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1085/2198] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:07.108043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=51 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:10.388527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:10.402045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4bf7-3390-4658-8f17-8b91f4fc16dd service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:10.409007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b906ff8-0b2d-48e4-8046-07c2271de1d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:10.409634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906ff8-0b2d-48e4-8046-07c2271de1d9 service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:10.410092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906ff8-0b2d-48e4-8046-07c2271de1d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:10.410376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b906ff8-0b2d-48e4-8046-07c2271de1d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:10.412116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8b906ff8-0b2d-48e4-8046-07c2271de1d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:10.472934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b906ff8-0b2d-48e4-8046-07c2271de1d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:10.474626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b906ff8-0b2d-48e4-8046-07c2271de1d9 service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:10.483734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1114/2199] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:12.901308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:12.902702 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:12.917471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15dc8-af1c-43d8-853d-9276d19da500 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:12.924589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:12.925224 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:12.925505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:12.925785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:12.927481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:12.988659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:12.990303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:13.000102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1086/2200] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:20.479486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=28 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:22.995454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=34 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:25.036487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190555-6715-46fe-bb7e-a85815628715 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:25.037001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190555-6715-46fe-bb7e-a85815628715 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:25.037270 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d190555-6715-46fe-bb7e-a85815628715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:25.059318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7d190555-6715-46fe-bb7e-a85815628715 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:25.061170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7d190555-6715-46fe-bb7e-a85815628715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:25.141662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1115/2201] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:25.159707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:25.161741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:25.236868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8231-c1c2-407a-9ced-7ea00285fd92 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:25.242416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:25.243035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:25.243318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:25.243591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:25.252060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:25.253675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:25.262229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1087/2202] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:43:33.800571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d190555-6715-46fe-bb7e-a85815628715 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:33.811074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d190555-6715-46fe-bb7e-a85815628715 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:33.814722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:33.815329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:33.815603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:33.815870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:33.817713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:33.895849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:33.898427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:33.911814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1116/2203] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:43:35.258985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=32 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:36.720750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:36.730752 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d533de3-400e-4e23-a963-f2592489766d service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:36.734386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:36.734989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:36.735272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:36.735550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:36.737372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:36.750049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:36.751503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:36.760628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1088/2204] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:38.481638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:38.484198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:38.495994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0b2a-ee64-4ff8-b9f5-6bceaf1aa6a1 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:38.500856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:38.501526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:38.501804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:38.502105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] PATH_INFO: `/v3/users/3ecfea42ece24ef095287d27dd752cb6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:38.503220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecfea42ece24ef095287d27dd752cb6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:38.505144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:38.678512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecfea42ece24ef095287d27dd752cb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:38.685633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecfea42ece24ef095287d27dd752cb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:38.731221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecfea42ece24ef095287d27dd752cb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:38.743557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecfea42ece24ef095287d27dd752cb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:38.744195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c73614ea-738a-4e07-9c57-14e91d96304b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecfea42ece24ef095287d27dd752cb6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:38.749972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1117/2205] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:43:38 2022] DELETE /identity/v3/users/3ecfea42ece24ef095287d27dd752cb6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:38.995240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:39.007302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5034725-0da8-4bb4-85d9-ba12f0a1a474 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:39.065728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:39.066298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.066566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.066837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] PATH_INFO: `/v3/projects/991b8df75560400ab53df07d68c506a5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.067949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991b8df75560400ab53df07d68c506a5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:39.072124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:39.187480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991b8df75560400ab53df07d68c506a5', 'request_id': 'req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:39.255124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991b8df75560400ab53df07d68c506a5', 'request_id': 'req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:39.261796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991b8df75560400ab53df07d68c506a5', 'request_id': 'req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:39.272932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] The token cache is being invalidate because project 991b8df75560400ab53df07d68c506a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:43:39.273248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:39.273879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-38a7f7cc-aad6-49f6-91eb-04a9a5e6c662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:39.275349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1089/2206] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:43:38 2022] DELETE /identity/v3/projects/991b8df75560400ab53df07d68c506a5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:39.280293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2c981-7341-43c1-b641-fbb7e8484fff None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.280581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2c981-7341-43c1-b641-fbb7e8484fff None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.280858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2c981-7341-43c1-b641-fbb7e8484fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.300870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-08a2c981-7341-43c1-b641-fbb7e8484fff None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:39.302107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-08a2c981-7341-43c1-b641-fbb7e8484fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:39.308441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:39.372822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1118/2207] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:39.374425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d7ef1-4e22-4439-8ba5-95bce60a4842 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.374774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d7ef1-4e22-4439-8ba5-95bce60a4842 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.375114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d7ef1-4e22-4439-8ba5-95bce60a4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.395688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-388d7ef1-4e22-4439-8ba5-95bce60a4842 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:39.396950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-388d7ef1-4e22-4439-8ba5-95bce60a4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:39.405331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1090/2208] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:43:39.409652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2c981-7341-43c1-b641-fbb7e8484fff None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:39.420008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2c981-7341-43c1-b641-fbb7e8484fff None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:39.424565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:39.425701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.425701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.425929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.426385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:43:39.426683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:39.428262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:39.440473 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1119/2209] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:43:39.445918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d7ef1-4e22-4439-8ba5-95bce60a4842 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:39.455317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d7ef1-4e22-4439-8ba5-95bce60a4842 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:39.460104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:39.460870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.461179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.461463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.462100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:39.464032 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:39.559695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1091/2210] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:43:39 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:39.561132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:39.571778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1c77a-6304-48f4-bab5-4feaaa29f10d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:39.627953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:39.628557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.628835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.629136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.629756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:39.631656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:39.710877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1120/2211] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:43:39 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:39.714925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:39.738615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551220-74c6-48b3-ae3c-9e124474cb3f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:39.746737 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:39.748317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.749500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.750268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.751927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:39.755879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:39.796196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1092/2212] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:43:39.798055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:39.811765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617e52-2940-44e9-9b7b-f53bf34aca2f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:39.824024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc7668-68d9-43c8-8cdc-08c16e891224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:39.824587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7668-68d9-43c8-8cdc-08c16e891224 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.824864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7668-68d9-43c8-8cdc-08c16e891224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.825161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7668-68d9-43c8-8cdc-08c16e891224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.825812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc7668-68d9-43c8-8cdc-08c16e891224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:39.827453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc7668-68d9-43c8-8cdc-08c16e891224 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:39.857884 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1121/2213] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:43:39.862211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:39.874416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695b1e9-e4b9-4ad2-a0ab-91d65283ad4d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:39.888593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:39.889305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:39.889642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:39.889938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] PATH_INFO: `/v3/projects/db93458009284f0abf386c08e3806f81/users/faab506810b1438988cf99148910ca9a/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:39.914247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db93458009284f0abf386c08e3806f81, user_id=faab506810b1438988cf99148910ca9a, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:39.914247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:40.024279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1093/2214] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:43:39 2022] PUT /identity/v3/projects/db93458009284f0abf386c08e3806f81/users/faab506810b1438988cf99148910ca9a/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:40.035524 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815728e-a43f-4d76-8b00-dca7d4551c83 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:40.035836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815728e-a43f-4d76-8b00-dca7d4551c83 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:40.036093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815728e-a43f-4d76-8b00-dca7d4551c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:40.065068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a815728e-a43f-4d76-8b00-dca7d4551c83 None None] MFA Rules not processed for user `faab506810b1438988cf99148910ca9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:40.066292 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a815728e-a43f-4d76-8b00-dca7d4551c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:40.132346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1122/2215] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:40.143323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:40.145071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:40.159777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:40.219162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312433cd-2f37-49c5-a475-f1637af2eafb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:40.224811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91397eda-712d-4239-bc74-e5c89399bb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:40.226173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91397eda-712d-4239-bc74-e5c89399bb87 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:40.226455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91397eda-712d-4239-bc74-e5c89399bb87 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:40.226723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91397eda-712d-4239-bc74-e5c89399bb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:40.234958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91397eda-712d-4239-bc74-e5c89399bb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:40.236539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91397eda-712d-4239-bc74-e5c89399bb87 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:40.245392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1094/2216] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:40.462195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815728e-a43f-4d76-8b00-dca7d4551c83 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:40.471011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:40.524815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815728e-a43f-4d76-8b00-dca7d4551c83 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:40.529583 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:40.530206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:40.530483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:40.530753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] PATH_INFO: `/v3/users/faab506810b1438988cf99148910ca9a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:40.531909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faab506810b1438988cf99148910ca9a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:40.533959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:40.727851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faab506810b1438988cf99148910ca9a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:40.734797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faab506810b1438988cf99148910ca9a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:40.776985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faab506810b1438988cf99148910ca9a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:40.789459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faab506810b1438988cf99148910ca9a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:40.790147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faab506810b1438988cf99148910ca9a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:40.796599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1123/2217] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:43:40 2022] DELETE /identity/v3/users/faab506810b1438988cf99148910ca9a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:40.801301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:40.801587 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:40.801857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:40.821767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:40.822958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:40.881127 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1095/2218] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:40.891499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:40.892857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:40.949267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f369-bfd2-4f3e-a71a-280b4e8aab53 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:40.952808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c89392-5065-49be-9a44-7e7f4291e3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:40.953435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c89392-5065-49be-9a44-7e7f4291e3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:40.953830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c89392-5065-49be-9a44-7e7f4291e3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:40.954001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c89392-5065-49be-9a44-7e7f4291e3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:40.963737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c89392-5065-49be-9a44-7e7f4291e3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:40.965401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c89392-5065-49be-9a44-7e7f4291e3b9 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:40.977203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1124/2219] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:41.487893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:41.489916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:41.507931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007acd1-bd8f-4ff4-adfd-0bb79eef3bb0 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:41.515332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:41.516008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:41.516355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:41.516508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] PATH_INFO: `/v3/projects/db93458009284f0abf386c08e3806f81` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:41.517661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db93458009284f0abf386c08e3806f81)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:41.519584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:41.662041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db93458009284f0abf386c08e3806f81', 'request_id': 'req-8a54963f-77c1-489d-81ca-3660885cc5e3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:41.729553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db93458009284f0abf386c08e3806f81', 'request_id': 'req-8a54963f-77c1-489d-81ca-3660885cc5e3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:41.735608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db93458009284f0abf386c08e3806f81', 'request_id': 'req-8a54963f-77c1-489d-81ca-3660885cc5e3'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:41.747097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] The token cache is being invalidate because project db93458009284f0abf386c08e3806f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:43:41.747328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:41.747958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8a54963f-77c1-489d-81ca-3660885cc5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:41.749490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1096/2220] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:43:41 2022] DELETE /identity/v3/projects/db93458009284f0abf386c08e3806f81 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:43:41.754426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09122-ac03-4c92-9889-b8d7e4177669 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:41.754901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09122-ac03-4c92-9889-b8d7e4177669 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:41.755012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09122-ac03-4c92-9889-b8d7e4177669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:41.775691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f3a09122-ac03-4c92-9889-b8d7e4177669 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:41.776878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f3a09122-ac03-4c92-9889-b8d7e4177669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:41.800712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:41.835913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1125/2221] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:41.844138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81fcc-d897-4a9f-ad44-1e2acc7f139a None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:41.844691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81fcc-d897-4a9f-ad44-1e2acc7f139a None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:41.844897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81fcc-d897-4a9f-ad44-1e2acc7f139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:41.865451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-78a81fcc-d897-4a9f-ad44-1e2acc7f139a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:41.866655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-78a81fcc-d897-4a9f-ad44-1e2acc7f139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:41.874637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1097/2222] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:41.878909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09122-ac03-4c92-9889-b8d7e4177669 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:41.888781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09122-ac03-4c92-9889-b8d7e4177669 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:41.893448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:41.894043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:41.894324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:41.894597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:41.895243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:43:41.895547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:41.897986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:41.910040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1126/2223] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:43:41.914709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81fcc-d897-4a9f-ad44-1e2acc7f139a None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:41.924243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81fcc-d897-4a9f-ad44-1e2acc7f139a None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:41.928863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:41.929503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:41.929783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:41.930056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:41.930698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:41.932588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:41.947887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:42.025477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1098/2224] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:43:41 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:42.029511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.039431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5318-55ad-4fde-a799-0692520540ef admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.096267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.096877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.100129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.100129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.100129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.100129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.119852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.121617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:42.190503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1127/2225] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:43:42 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:42.194977 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.200170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3ab3-007d-43a1-9b65-1d1f4188d200 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.205884 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78fadd-1afa-46fc-b4c4-4f97cae08719 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.207401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4fb21-1f94-41bf-a9af-eca3f8e95695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.208314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fb21-1f94-41bf-a9af-eca3f8e95695 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.208602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fb21-1f94-41bf-a9af-eca3f8e95695 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.208880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fb21-1f94-41bf-a9af-eca3f8e95695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.211079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e5b4fb21-1f94-41bf-a9af-eca3f8e95695 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:42.211201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.211841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.212119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.212433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.212992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.214616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.226329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1128/2226] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:43:42.230501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.240615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be01a5-8d58-4ad4-a4c4-f69e712ed79f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.246524 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.247122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.247400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.247674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.248311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.250073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.261316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1129/2227] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:43:42.265395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.275069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94da2-6aa7-4575-a65d-3bf1df732c7d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.279864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.280451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.280739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.281000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] PATH_INFO: `/v3/projects/5cd98c710c9e482484c05cc2681d35b4/users/25e6c321c43840c1853b0155a60fc315/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.299125 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd98c710c9e482484c05cc2681d35b4, user_id=25e6c321c43840c1853b0155a60fc315, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.301394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4fb21-1f94-41bf-a9af-eca3f8e95695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.301833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.302992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4fb21-1f94-41bf-a9af-eca3f8e95695 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.313315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1099/2228] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:43:42.376733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1130/2229] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:43:42 2022] PUT /identity/v3/projects/5cd98c710c9e482484c05cc2681d35b4/users/25e6c321c43840c1853b0155a60fc315/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:42.386616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32f52-c699-429a-860b-bd8fa3d158d4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.386909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32f52-c699-429a-860b-bd8fa3d158d4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.387255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32f52-c699-429a-860b-bd8fa3d158d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.420258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e1e32f52-c699-429a-860b-bd8fa3d158d4 None None] MFA Rules not processed for user `25e6c321c43840c1853b0155a60fc315`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:42.421533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e1e32f52-c699-429a-860b-bd8fa3d158d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:42.488795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1100/2230] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:42.494021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.555495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f1fe-ee1d-4cc8-8c96-8cafabd84a91 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.560208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.561443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.561443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.561443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.562051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.563957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.568456 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:42.682179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1131/2231] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:43:42 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:42.684064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e32f52-c699-429a-860b-bd8fa3d158d4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.698453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e32f52-c699-429a-860b-bd8fa3d158d4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.715445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:42.754583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.755189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.755467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.755735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.756364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.758323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.867691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1101/2232] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:43:42 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:42.871845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.881956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52b9c2-32be-4981-a350-56b9caf0f993 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.886742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.887340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.887618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.887910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.888532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.890152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:42.900360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1132/2233] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:43:42.904597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:42.914431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f18d58-01dc-4c1b-8dbb-78f992db4650 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:42.920408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:42.921181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:42.921461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:42.922172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] PATH_INFO: `/v3/projects/adcc9a194ec0409c82eeef4cc0fc6ed7/users/33a473a6df3340aeaf0e344c8a31e96c/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:42.938779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcc9a194ec0409c82eeef4cc0fc6ed7, user_id=33a473a6df3340aeaf0e344c8a31e96c, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:42.941514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:43.065754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1102/2234] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:43:42 2022] PUT /identity/v3/projects/adcc9a194ec0409c82eeef4cc0fc6ed7/users/33a473a6df3340aeaf0e344c8a31e96c/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:43.068861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:43.079944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfadce-e5cf-47a0-b64e-9aba7b85d040 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:43.143828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:43.144437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:43.144711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:43.144980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:43.145679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:43.147245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:43.157783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1133/2235] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:43:43.162038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:43.173338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:43.173647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899022d-5a70-4171-ace8-efd8366ef22a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:43.175039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:43.178804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a2a45-132f-494e-8b80-f41863caf944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:43.180984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a2a45-132f-494e-8b80-f41863caf944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:43.180984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a2a45-132f-494e-8b80-f41863caf944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:43.180984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a2a45-132f-494e-8b80-f41863caf944 admin admin] PATH_INFO: `/v3/projects/adcc9a194ec0409c82eeef4cc0fc6ed7/users/33a473a6df3340aeaf0e344c8a31e96c/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:43.182973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a2a45-132f-494e-8b80-f41863caf944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcc9a194ec0409c82eeef4cc0fc6ed7, user_id=33a473a6df3340aeaf0e344c8a31e96c, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:43.186776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a2a45-132f-494e-8b80-f41863caf944 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:43.199186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1103/2236] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:43:43 2022] PUT /identity/v3/projects/adcc9a194ec0409c82eeef4cc0fc6ed7/users/33a473a6df3340aeaf0e344c8a31e96c/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:43.211446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:43.211813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:43.212178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:43.241498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] MFA Rules not processed for user `33a473a6df3340aeaf0e344c8a31e96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:43.242136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ddc9b-4ce4-4a29-9779-02c3f329677e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:43.242856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:43.292409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:43.293004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:43.293306 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:43.293586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:43.295672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:43.306811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:43.308256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:43.316666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1134/2237] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:43:43.319684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1104/2238] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:43:43.331614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:43.333226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:43.365459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:43.390576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b661cf-d006-4cf6-a815-73e45f0ae205 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:43.394295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:43.394897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:43.395173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:43.395444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:43.404205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:43.405663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:43.415719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1135/2239] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:44.075555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:44.076997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:44.139105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:44.160662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d7e2-0cbd-40e1-bf9b-d1437d844265 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:44.166028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840955d0-9c9d-4b77-8a73-5769382249cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:44.166722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840955d0-9c9d-4b77-8a73-5769382249cc service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:44.167084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840955d0-9c9d-4b77-8a73-5769382249cc service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:44.167417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840955d0-9c9d-4b77-8a73-5769382249cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:44.169606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-840955d0-9c9d-4b77-8a73-5769382249cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:44.181940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840955d0-9c9d-4b77-8a73-5769382249cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:44.183779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840955d0-9c9d-4b77-8a73-5769382249cc service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:44.194005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1105/2240] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:44.420939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:44.482924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1391d-36c7-4f0d-aa3a-47d7c1682760 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:44.487457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:44.488078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:44.488356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:44.488626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] PATH_INFO: `/v3/users/25e6c321c43840c1853b0155a60fc315` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:44.489761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e6c321c43840c1853b0155a60fc315)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:44.491654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:44.763082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e6c321c43840c1853b0155a60fc315'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:44.769894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e6c321c43840c1853b0155a60fc315'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:44.872991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e6c321c43840c1853b0155a60fc315'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:44.888554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e6c321c43840c1853b0155a60fc315'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:44.889326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e6c321c43840c1853b0155a60fc315'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:44.895696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1136/2241] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:43:44 2022] DELETE /identity/v3/users/25e6c321c43840c1853b0155a60fc315 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:44.900162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:44.900492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:44.900976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:44.920411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:44.921767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:44.991633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1106/2242] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:45.004894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:45.006559 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:45.090638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d804e-055c-440f-8877-0b0f672cdeef admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:45.094280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:45.094807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:45.095081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:45.095349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:45.101379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:45.107306 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:45.108791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:45.119491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1137/2243] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:45.594852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:45.596306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:45.608636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996b96-7511-47cc-8d1d-1d8cb5add92b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:45.613759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:45.614398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:45.614679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:45.614951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] PATH_INFO: `/v3/projects/5cd98c710c9e482484c05cc2681d35b4` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:45.616080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd98c710c9e482484c05cc2681d35b4)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:45.618026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:45.731813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd98c710c9e482484c05cc2681d35b4', 'request_id': 'req-dcb20e6f-22e6-4000-8fcf-91a86615875c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:45.820790 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd98c710c9e482484c05cc2681d35b4', 'request_id': 'req-dcb20e6f-22e6-4000-8fcf-91a86615875c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:45.827359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd98c710c9e482484c05cc2681d35b4', 'request_id': 'req-dcb20e6f-22e6-4000-8fcf-91a86615875c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:45.838836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] The token cache is being invalidate because project 5cd98c710c9e482484c05cc2681d35b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:43:45.839122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:45.839793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:45.841525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1107/2244] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:43:45 2022] DELETE /identity/v3/projects/5cd98c710c9e482484c05cc2681d35b4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:45.845885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:45.856173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70c0c-693a-4742-bd19-398d442dda35 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:45.915288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:45.915999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:45.916243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:45.916515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] PATH_INFO: `/v3/users/33a473a6df3340aeaf0e344c8a31e96c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:45.917656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a473a6df3340aeaf0e344c8a31e96c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:45.920116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:46.169736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a473a6df3340aeaf0e344c8a31e96c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:46.179202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a473a6df3340aeaf0e344c8a31e96c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:46.274479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a473a6df3340aeaf0e344c8a31e96c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:46.287113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a473a6df3340aeaf0e344c8a31e96c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:46.287752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ee983bab-0761-403e-90d3-180318ad347d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a473a6df3340aeaf0e344c8a31e96c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:46.294185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1138/2245] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:43:45 2022] DELETE /identity/v3/users/33a473a6df3340aeaf0e344c8a31e96c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:46.944340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:46.945898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:46.959467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20e6f-22e6-4000-8fcf-91a86615875c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:47.022381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:47.023022 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.023419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.023565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] PATH_INFO: `/v3/projects/adcc9a194ec0409c82eeef4cc0fc6ed7` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.024698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcc9a194ec0409c82eeef4cc0fc6ed7)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:47.027848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:47.040635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:47.212059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcc9a194ec0409c82eeef4cc0fc6ed7', 'request_id': 'req-53c9740f-c91c-4045-9d48-91df622d981c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:47.338228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcc9a194ec0409c82eeef4cc0fc6ed7', 'request_id': 'req-53c9740f-c91c-4045-9d48-91df622d981c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:47.344496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcc9a194ec0409c82eeef4cc0fc6ed7', 'request_id': 'req-53c9740f-c91c-4045-9d48-91df622d981c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:47.358144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] The token cache is being invalidate because project adcc9a194ec0409c82eeef4cc0fc6ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:43:47.358585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:47.359279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-53c9740f-c91c-4045-9d48-91df622d981c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:47.360771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1108/2246] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:43:46 2022] DELETE /identity/v3/projects/adcc9a194ec0409c82eeef4cc0fc6ed7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:47.366348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccc7e5-f406-43f7-996e-80be930e6c4f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.366823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccc7e5-f406-43f7-996e-80be930e6c4f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.366964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccc7e5-f406-43f7-996e-80be930e6c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.496827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.497402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.498267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.524300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:47.525876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:47.533951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-f6ccc7e5-f406-43f7-996e-80be930e6c4f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:47.535224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f6ccc7e5-f406-43f7-996e-80be930e6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:47.584162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1109/2247] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:47.596219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:47.597103 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1139/2248] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:47.609631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:47.609777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa115f-98a1-474f-9363-ea0620b89848 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.609777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa115f-98a1-474f-9363-ea0620b89848 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.609777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa115f-98a1-474f-9363-ea0620b89848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.625560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1dfa115f-98a1-474f-9363-ea0620b89848 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:47.626757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1dfa115f-98a1-474f-9363-ea0620b89848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:47.634848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1140/2249] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:43:47.641220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa115f-98a1-474f-9363-ea0620b89848 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:47.650343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa115f-98a1-474f-9363-ea0620b89848 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:47.656312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:47.657019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.657388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.657660 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.658310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:43:47.658612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:47.660368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:47.662058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:47.674083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1141/2250] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:43:47.677589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a80fab-87ca-4946-998d-09719077d8c9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:47.678579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:47.683391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:47.684011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.684288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.684557 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.688953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04913c-5c40-4014-ab60-48b79e134721 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:47.693582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:47.693787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:47.694374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.694654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.694925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.695167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:47.695544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:47.697496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:47.703519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1110/2251] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 21:43:47.789928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1142/2252] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:43:47 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:47.795179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:47.806293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8262ac-6ad3-4194-b325-b70460423b8a service swift] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:47.842324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:47.871576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:47.872195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:47.872606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:47.872885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:47.873679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:47.875649 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:48.025078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1111/2253] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:43:47 2022] POST /identity/v3/users => generated 303 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:43:48.027565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:48.044666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668649f-bb1e-475c-b7f4-9edfefb19a6e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:48.052668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:48.053346 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.053672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.053923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.054596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:48.056331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:48.067688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1143/2254] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:43:48.072584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:48.086188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69b64e-2c4b-48bc-8fe5-a08b247c3b87 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:48.092215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937226b-d828-459e-a0f8-1356b9b61036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:48.092865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937226b-d828-459e-a0f8-1356b9b61036 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.093540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937226b-d828-459e-a0f8-1356b9b61036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.093933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937226b-d828-459e-a0f8-1356b9b61036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.094726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937226b-d828-459e-a0f8-1356b9b61036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:48.096386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937226b-d828-459e-a0f8-1356b9b61036 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:48.114242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1112/2255] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:43:48.115315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:48.129866 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b75b-b79c-40ff-a713-cd4805a0db95 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:48.136129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:48.136972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.141450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.141828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] PATH_INFO: `/v3/projects/db1aa8874b154287a4ae87e18d373e04/users/91ebb7a8b56842c79595dfebca519e01/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.162832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1aa8874b154287a4ae87e18d373e04, user_id=91ebb7a8b56842c79595dfebca519e01, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:48.170280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:48.323084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1144/2256] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:43:48 2022] PUT /identity/v3/projects/db1aa8874b154287a4ae87e18d373e04/users/91ebb7a8b56842c79595dfebca519e01/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:43:48.334921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b67ce-61cd-44af-ac52-4163abbc515b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.335510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b67ce-61cd-44af-ac52-4163abbc515b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.336037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b67ce-61cd-44af-ac52-4163abbc515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.370597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-403b67ce-61cd-44af-ac52-4163abbc515b None None] MFA Rules not processed for user `91ebb7a8b56842c79595dfebca519e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:48.371969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-403b67ce-61cd-44af-ac52-4163abbc515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:48.446796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1113/2257] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:48.451827 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:48.537961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5f548-5cf7-4f74-9962-b4a961dda3f7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:48.546952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:48.547703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.548068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.548440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.549232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:48.551772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:48.646213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1145/2258] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:43:48 2022] POST /identity/v3/projects => generated 409 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:43:48.650610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b67ce-61cd-44af-ac52-4163abbc515b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:48.667208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b67ce-61cd-44af-ac52-4163abbc515b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:48.759114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:48.760240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.760606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.760875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.761568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:48.763527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:48.889063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1114/2259] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:43:48 2022] POST /identity/v3/users => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:43:48.892910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:48.907858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95208-77a2-4e04-b0b1-17a528e0fbe6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:48.912504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:48.913234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.913507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.913774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.914424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:48.916964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:48.929833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1146/2260] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:43:48.935577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:48.946791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da427c0-9c0d-4b68-b2fc-2bcd7ac30d10 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:48.951982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:48.952639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:48.953088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:48.953367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] PATH_INFO: `/v3/projects/07142737c9854d929f46eaccf6b392a2/users/ad154eb4c2624f9287548f50f44f7dc9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:48.970351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=07142737c9854d929f46eaccf6b392a2, user_id=ad154eb4c2624f9287548f50f44f7dc9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:48.973335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:49.054033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1115/2261] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:43:48 2022] PUT /identity/v3/projects/07142737c9854d929f46eaccf6b392a2/users/ad154eb4c2624f9287548f50f44f7dc9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:49.058722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:49.068933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589fa57-4ec7-42f2-96d8-2cdf13b9336d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:49.151675 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96689cc-3d26-4608-8526-d69553179085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:49.153710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96689cc-3d26-4608-8526-d69553179085 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:49.153710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96689cc-3d26-4608-8526-d69553179085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:49.153710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96689cc-3d26-4608-8526-d69553179085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:49.163867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96689cc-3d26-4608-8526-d69553179085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:49.165779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96689cc-3d26-4608-8526-d69553179085 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:49.178664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1147/2262] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:43:49.183051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:49.194409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f267-a949-42fe-8d2a-1fad862f6dde admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:49.203140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:49.203972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:49.204252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:49.204529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] PATH_INFO: `/v3/projects/07142737c9854d929f46eaccf6b392a2/users/ad154eb4c2624f9287548f50f44f7dc9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:49.206812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07142737c9854d929f46eaccf6b392a2, user_id=ad154eb4c2624f9287548f50f44f7dc9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:49.213671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:49.214055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:49.222924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1116/2263] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:43:49 2022] PUT /identity/v3/projects/07142737c9854d929f46eaccf6b392a2/users/ad154eb4c2624f9287548f50f44f7dc9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:49.237348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737ccbc-7d95-47e0-bdba-b9320a7f8f35 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:49.237630 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737ccbc-7d95-47e0-bdba-b9320a7f8f35 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:49.239225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737ccbc-7d95-47e0-bdba-b9320a7f8f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:49.258189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:49.275147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6737ccbc-7d95-47e0-bdba-b9320a7f8f35 None None] MFA Rules not processed for user `ad154eb4c2624f9287548f50f44f7dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:49.277562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6737ccbc-7d95-47e0-bdba-b9320a7f8f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:49.429082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1148/2264] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:49.440386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:49.442167 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:49.532647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d10ed-f092-4679-84ae-da59cac61594 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:49.536528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:49.537231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:49.537512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:49.537782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:49.550190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:49.554488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:49.566823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1117/2265] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:49.974227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737ccbc-7d95-47e0-bdba-b9320a7f8f35 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:49.984235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737ccbc-7d95-47e0-bdba-b9320a7f8f35 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:49.987912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db751fe-ff64-48a6-8c46-a31f89871dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:49.988584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db751fe-ff64-48a6-8c46-a31f89871dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:49.988948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db751fe-ff64-48a6-8c46-a31f89871dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:49.989318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db751fe-ff64-48a6-8c46-a31f89871dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:50.049246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db751fe-ff64-48a6-8c46-a31f89871dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:50.050601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db751fe-ff64-48a6-8c46-a31f89871dd8 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:50.059828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1149/2266] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:49 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:43:57.218826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:57.299959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e59c-07bd-4d73-86f7-1ec445b058c6 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:57.304456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:57.305116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:57.305398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:57.305667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] PATH_INFO: `/v3/users/91ebb7a8b56842c79595dfebca519e01` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:57.307303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ebb7a8b56842c79595dfebca519e01)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:57.309269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:57.491606 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ebb7a8b56842c79595dfebca519e01'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:57.492256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ebb7a8b56842c79595dfebca519e01'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:57.499936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ebb7a8b56842c79595dfebca519e01'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:57.513250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ebb7a8b56842c79595dfebca519e01'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:57.513376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ebb7a8b56842c79595dfebca519e01'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:57.613709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1118/2267] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:43:57 2022] DELETE /identity/v3/users/91ebb7a8b56842c79595dfebca519e01 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:57.618297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:57.618775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:57.618878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:57.639019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:57.640282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:57.721170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1150/2268] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:57.730365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:57.731730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:57.755579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:57.812642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034ebd9-62fc-4688-993d-c6af5d95fa2c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:57.816608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:57.817252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:57.817533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:57.817816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:57.828445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:57.831026 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:57.840110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1119/2269] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:43:58.316437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:58.318258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:58.342853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469afbce-d308-46a6-b918-2fbeef09a92f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:58.348398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:58.351073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:58.351073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:58.351073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] PATH_INFO: `/v3/projects/db1aa8874b154287a4ae87e18d373e04` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:58.351073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1aa8874b154287a4ae87e18d373e04)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:58.352865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:58.474861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:58.492509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1aa8874b154287a4ae87e18d373e04', 'request_id': 'req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.499139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1aa8874b154287a4ae87e18d373e04', 'request_id': 'req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.505401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1aa8874b154287a4ae87e18d373e04', 'request_id': 'req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.593168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] The token cache is being invalidate because project db1aa8874b154287a4ae87e18d373e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:43:58.593460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.594099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.595590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1151/2270] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:43:58 2022] DELETE /identity/v3/projects/db1aa8874b154287a4ae87e18d373e04 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:58.600473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:58.610739 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45962f7a-e6b8-4661-a721-d8d8e5856bfc service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:58.665598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:58.666220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:58.667084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:58.667314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] PATH_INFO: `/v3/users/ad154eb4c2624f9287548f50f44f7dc9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:58.668470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad154eb4c2624f9287548f50f44f7dc9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:58.670710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:58.874070 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad154eb4c2624f9287548f50f44f7dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.874834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad154eb4c2624f9287548f50f44f7dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.882297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad154eb4c2624f9287548f50f44f7dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.894538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad154eb4c2624f9287548f50f44f7dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.895272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c64c5935-8c18-4374-acc9-a14adbf53c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad154eb4c2624f9287548f50f44f7dc9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:58.987338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1120/2271] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:43:58 2022] DELETE /identity/v3/users/ad154eb4c2624f9287548f50f44f7dc9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:59.425623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:59.427156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:59.443065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8eb8d-8573-4cca-8141-5afbc447d8bc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:59.502749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:59.503388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:59.503673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:59.503949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] PATH_INFO: `/v3/projects/07142737c9854d929f46eaccf6b392a2` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:59.505092 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07142737c9854d929f46eaccf6b392a2)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:59.507044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:59.643746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07142737c9854d929f46eaccf6b392a2', 'request_id': 'req-09bc06d9-9097-4b8d-ad61-f8190eed698b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:59.649888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07142737c9854d929f46eaccf6b392a2', 'request_id': 'req-09bc06d9-9097-4b8d-ad61-f8190eed698b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:59.657779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07142737c9854d929f46eaccf6b392a2', 'request_id': 'req-09bc06d9-9097-4b8d-ad61-f8190eed698b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:59.760511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] The token cache is being invalidate because project 07142737c9854d929f46eaccf6b392a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:43:59.760966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:59.761748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-09bc06d9-9097-4b8d-ad61-f8190eed698b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:43:59.763291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1152/2272] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:43:59 2022] DELETE /identity/v3/projects/07142737c9854d929f46eaccf6b392a2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:43:59.769073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:59.769073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:59.769073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:59.791119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:59.792952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:59.827007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:43:59.865410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1121/2273] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:59.874096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43345-d693-4b2f-959f-c6d48d184789 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:59.874378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43345-d693-4b2f-959f-c6d48d184789 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:59.874661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43345-d693-4b2f-959f-c6d48d184789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:59.876815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:59.878738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:59.896120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5ec43345-d693-4b2f-959f-c6d48d184789 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:43:59.898953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5ec43345-d693-4b2f-959f-c6d48d184789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:59.905837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1153/2274] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:43:59.909986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43345-d693-4b2f-959f-c6d48d184789 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:59.925668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43345-d693-4b2f-959f-c6d48d184789 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:59.930515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:59.931138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:59.931420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:59.931691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:59.932953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:43:59.933288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:59.934938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:59.954087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1154/2275] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:43:59.954259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15375738-457b-4e44-a690-67ceb64f6893 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:59.955297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:43:59.959888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:59.960510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:59.960796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:59.961098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:59.962981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:43:59.966935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de5b1-9c3c-4cea-b51e-991e10ecc14e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:43:59.972305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:43:59.973772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:43:59.973772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:43:59.973772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:43:59.974493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:59.975646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:43:59.976374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:59.977615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:43:59.990495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1122/2276] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:43:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:00.065093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1155/2277] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:43:59 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:00.069262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:00.079801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4b70e-33c7-4fee-bb65-39ec872e1858 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:00.135738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:00.136271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.136551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.136824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.137500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:00.139440 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:00.262248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1123/2278] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:00 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:00.263972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:00.269414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:00.274601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385758a-522e-4ab7-8a43-f256e4c15922 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:00.279940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:00.280540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.280821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.281121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.281768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:00.283530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:00.297484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1156/2279] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:00.298659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:00.309497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd834f-06a4-4bd8-ab8f-e7d21cb49cea admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:00.314695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae7713-eee0-470b-b227-be6f87fa54f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:00.315988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae7713-eee0-470b-b227-be6f87fa54f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.315988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae7713-eee0-470b-b227-be6f87fa54f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.315988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae7713-eee0-470b-b227-be6f87fa54f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.316462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae7713-eee0-470b-b227-be6f87fa54f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:00.318090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae7713-eee0-470b-b227-be6f87fa54f4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:00.328466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1124/2280] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:00.332683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:00.343994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587714e-0182-4f3c-a8a0-00e4a4b9e407 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:00.348509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:00.349205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.349479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.349744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] PATH_INFO: `/v3/projects/7f3c1dcde0404cfdb9ad32e22aea1962/users/0cde5d27bd9e4ecb9e83be8079388fda/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.365728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3c1dcde0404cfdb9ad32e22aea1962, user_id=0cde5d27bd9e4ecb9e83be8079388fda, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:00.368337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:00.458879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1157/2281] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:00 2022] PUT /identity/v3/projects/7f3c1dcde0404cfdb9ad32e22aea1962/users/0cde5d27bd9e4ecb9e83be8079388fda/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:00.472624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc99dd7-b2a4-4134-9afa-9cf7973717bb None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.472916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc99dd7-b2a4-4134-9afa-9cf7973717bb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.473248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc99dd7-b2a4-4134-9afa-9cf7973717bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.501753 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2bc99dd7-b2a4-4134-9afa-9cf7973717bb None None] MFA Rules not processed for user `0cde5d27bd9e4ecb9e83be8079388fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:00.502963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2bc99dd7-b2a4-4134-9afa-9cf7973717bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:00.538439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:00.572172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1125/2282] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:00.577178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:00.639080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62eb6a-1561-43c8-a664-777ce53a020b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:00.643800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:00.644397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.644672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.644939 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.645595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:00.647470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:00.768264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1158/2283] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:00 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:00.772580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc99dd7-b2a4-4134-9afa-9cf7973717bb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:00.790237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc99dd7-b2a4-4134-9afa-9cf7973717bb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:00.864892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:00.865515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.865791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.866060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.866719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:00.868669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:00.949080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1126/2284] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:00 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:00.953578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:00.964158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27217e1-f5ee-4f85-af4e-65b6ec0f0348 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:00.968883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:00.969517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:00.969799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:00.970071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:00.970724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:00.972273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:00.982896 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1159/2285] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:00.988043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:01.000105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e256fe-053d-420f-88d2-b4a61482a58d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:01.004243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:01.004897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:01.005211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:01.005538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] PATH_INFO: `/v3/projects/e11e8b963e174415a658a53090ca20a0/users/38db5eaf74834cabb9fca46f9b5927ff/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:01.021998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11e8b963e174415a658a53090ca20a0, user_id=38db5eaf74834cabb9fca46f9b5927ff, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:01.024803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:01.097428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1127/2286] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:00 2022] PUT /identity/v3/projects/e11e8b963e174415a658a53090ca20a0/users/38db5eaf74834cabb9fca46f9b5927ff/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:01.105174 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:01.111494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bc7e-c172-4335-ab42-c0f096550d26 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:01.171816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accd595-8f0c-48b1-b737-a00b7cd70738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:01.172474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd595-8f0c-48b1-b737-a00b7cd70738 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:01.172694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd595-8f0c-48b1-b737-a00b7cd70738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:01.172962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd595-8f0c-48b1-b737-a00b7cd70738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:01.173637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accd595-8f0c-48b1-b737-a00b7cd70738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:01.175201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accd595-8f0c-48b1-b737-a00b7cd70738 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:01.185507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1160/2287] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:01.189665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:01.201380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc72c6-2009-43b8-aa06-d2f191783601 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:01.206532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:01.207974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:01.207974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:01.207974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] PATH_INFO: `/v3/projects/e11e8b963e174415a658a53090ca20a0/users/38db5eaf74834cabb9fca46f9b5927ff/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:01.209661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11e8b963e174415a658a53090ca20a0, user_id=38db5eaf74834cabb9fca46f9b5927ff, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:01.212273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:01.223507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1128/2288] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:01 2022] PUT /identity/v3/projects/e11e8b963e174415a658a53090ca20a0/users/38db5eaf74834cabb9fca46f9b5927ff/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:01.234770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059669ba-29de-4efb-bfab-f199e1e049de None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:01.235071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059669ba-29de-4efb-bfab-f199e1e049de None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:01.235318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059669ba-29de-4efb-bfab-f199e1e049de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:01.264633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-059669ba-29de-4efb-bfab-f199e1e049de None None] MFA Rules not processed for user `38db5eaf74834cabb9fca46f9b5927ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:01.265873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-059669ba-29de-4efb-bfab-f199e1e049de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:01.293661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:01.335788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1161/2289] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:01.347878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:01.349681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:01.410199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714d715-8293-48d8-92a0-b4122e38d7e8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:01.414254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:01.414902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:01.415183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:01.415496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:01.427779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:01.429249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:01.441256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1129/2290] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:02.127803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c855a-fbc2-44d4-b56c-2e6113e70104 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:02.128225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c855a-fbc2-44d4-b56c-2e6113e70104 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:02.128379 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c855a-fbc2-44d4-b56c-2e6113e70104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:02.148627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7c0c855a-fbc2-44d4-b56c-2e6113e70104 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:02.149970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7c0c855a-fbc2-44d4-b56c-2e6113e70104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:02.207335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1162/2291] 10.222.0.60 () {58 vars in 967 bytes} [Fri Sep 9 21:44:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:02.219632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:02.221054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:02.252920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:02.290996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b6b2-dc70-4f5c-b117-b106a007eb7f service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:02.299802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56040-1343-4681-b977-66961b0fda93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:02.300426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56040-1343-4681-b977-66961b0fda93 service swift] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:02.300744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56040-1343-4681-b977-66961b0fda93 service swift] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:02.301002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56040-1343-4681-b977-66961b0fda93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:02.310238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d56040-1343-4681-b977-66961b0fda93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:02.311847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d56040-1343-4681-b977-66961b0fda93 service swift] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:02.320651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1130/2292] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:44:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:44:02.866972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c855a-fbc2-44d4-b56c-2e6113e70104 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:02.932367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c855a-fbc2-44d4-b56c-2e6113e70104 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:02.938616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:02.939314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:02.939597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:02.939894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] PATH_INFO: `/v3/users/0cde5d27bd9e4ecb9e83be8079388fda` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:02.941146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cde5d27bd9e4ecb9e83be8079388fda)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:02.943087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:03.184872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cde5d27bd9e4ecb9e83be8079388fda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:03.194499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cde5d27bd9e4ecb9e83be8079388fda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:03.280614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cde5d27bd9e4ecb9e83be8079388fda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:03.287254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:03.301641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cde5d27bd9e4ecb9e83be8079388fda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:03.301641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cde5d27bd9e4ecb9e83be8079388fda'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:03.304914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1163/2293] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:02 2022] DELETE /identity/v3/users/0cde5d27bd9e4ecb9e83be8079388fda => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:03.309545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:03.310044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:03.310405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:03.330641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:03.331911 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:03.396406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1131/2294] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:03.407535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:03.408955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:03.491716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd5e3-1774-4e53-a12e-2612369c154c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:03.508415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:03.509072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:03.512087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:03.512366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:03.546088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:03.551217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:03.565228 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1164/2295] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:04.011971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:04.014094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:04.027306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72b18-9ec5-4f22-8272-f72005de4627 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:04.032787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:04.033483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:04.034369 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:04.034636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] PATH_INFO: `/v3/projects/7f3c1dcde0404cfdb9ad32e22aea1962` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:04.035769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3c1dcde0404cfdb9ad32e22aea1962)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:04.037766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:04.144654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3c1dcde0404cfdb9ad32e22aea1962', 'request_id': 'req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.230508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3c1dcde0404cfdb9ad32e22aea1962', 'request_id': 'req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.237476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3c1dcde0404cfdb9ad32e22aea1962', 'request_id': 'req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.250199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] The token cache is being invalidate because project 7f3c1dcde0404cfdb9ad32e22aea1962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:04.250493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.251240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.252817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1132/2296] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:04 2022] DELETE /identity/v3/projects/7f3c1dcde0404cfdb9ad32e22aea1962 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:04.257008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:04.267006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afa53d-efb5-417f-8945-7baa374e5f07 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:04.325695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:04.326329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:04.326608 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:04.326881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] PATH_INFO: `/v3/users/38db5eaf74834cabb9fca46f9b5927ff` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:04.328058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38db5eaf74834cabb9fca46f9b5927ff)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:04.330072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:04.526266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38db5eaf74834cabb9fca46f9b5927ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.533742 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38db5eaf74834cabb9fca46f9b5927ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.598618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38db5eaf74834cabb9fca46f9b5927ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.612228 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38db5eaf74834cabb9fca46f9b5927ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.612918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-669f2203-2fa3-4f73-be01-f61e744bed7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38db5eaf74834cabb9fca46f9b5927ff'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:04.618962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1165/2297] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:04 2022] DELETE /identity/v3/users/38db5eaf74834cabb9fca46f9b5927ff => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:05.063294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:05.065811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:05.081196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08545c5-555b-4e92-b92a-cfd1bdfe58d7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:05.124013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:05.140727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:05.141399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.141681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.141953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] PATH_INFO: `/v3/projects/e11e8b963e174415a658a53090ca20a0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.143068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11e8b963e174415a658a53090ca20a0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:05.144974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:05.275982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11e8b963e174415a658a53090ca20a0', 'request_id': 'req-c0eafdff-69c3-4efd-8eaf-4689e276e604'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:05.343703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11e8b963e174415a658a53090ca20a0', 'request_id': 'req-c0eafdff-69c3-4efd-8eaf-4689e276e604'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:05.350160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11e8b963e174415a658a53090ca20a0', 'request_id': 'req-c0eafdff-69c3-4efd-8eaf-4689e276e604'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:05.361770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] The token cache is being invalidate because project e11e8b963e174415a658a53090ca20a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:05.362054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:05.362800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c0eafdff-69c3-4efd-8eaf-4689e276e604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:05.364260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1133/2298] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:05 2022] DELETE /identity/v3/projects/e11e8b963e174415a658a53090ca20a0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:05.369077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6b5c0-ba3e-4ac1-b4bf-31595ef7b197 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.369548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6b5c0-ba3e-4ac1-b4bf-31595ef7b197 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.369642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6b5c0-ba3e-4ac1-b4bf-31595ef7b197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.390547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2ba6b5c0-ba3e-4ac1-b4bf-31595ef7b197 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:05.391805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2ba6b5c0-ba3e-4ac1-b4bf-31595ef7b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:05.396156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:05.453124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1166/2299] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:05.460997 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dca5f4-d0f3-4987-8f03-ff2339b5fd7d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.461315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dca5f4-d0f3-4987-8f03-ff2339b5fd7d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.461591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dca5f4-d0f3-4987-8f03-ff2339b5fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.482269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-31dca5f4-d0f3-4987-8f03-ff2339b5fd7d None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:05.483476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-31dca5f4-d0f3-4987-8f03-ff2339b5fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:05.491614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1134/2300] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:05.495710 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6b5c0-ba3e-4ac1-b4bf-31595ef7b197 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:05.507573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6b5c0-ba3e-4ac1-b4bf-31595ef7b197 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:05.513331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:05.514018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.514291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.514562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.515212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:05.515512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:05.517121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:05.528962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1167/2301] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:05.535691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dca5f4-d0f3-4987-8f03-ff2339b5fd7d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:05.547556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dca5f4-d0f3-4987-8f03-ff2339b5fd7d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:05.552415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:05.553014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.553316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.553678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.554328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:05.556238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:05.666392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1135/2302] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:05 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:05.673808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:05.692007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9e5f4-e060-4bdc-8055-4854feb43249 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:05.750930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:05.751539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.751822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.752091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.752751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:05.754694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:05.875852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1168/2303] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:05 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:05.879874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:05.890096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571b858-ebb1-485a-bbf1-79c6aa0fe6d3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:05.894767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:05.895351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.895626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.895892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.896646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:05.898267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:05.908148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1136/2304] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:05.911934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:05.922539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc095c42-32aa-44c4-96b0-365f86ad688a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:05.927033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68fbb-7544-4e87-916a-00ddcb0ec5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:05.927613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68fbb-7544-4e87-916a-00ddcb0ec5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.927888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68fbb-7544-4e87-916a-00ddcb0ec5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.928181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68fbb-7544-4e87-916a-00ddcb0ec5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.928828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a68fbb-7544-4e87-916a-00ddcb0ec5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:05.930428 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a68fbb-7544-4e87-916a-00ddcb0ec5f4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:05.941790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1169/2305] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:05.945767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:05.955460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9db1c7-abb8-4636-a99f-e849996e875e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:05.959945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:05.960582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:05.960863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:05.961173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] PATH_INFO: `/v3/projects/377068ed12454314b7716d646a232b6a/users/20ff57439c3d4c1199e94802d39862b2/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:05.975888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=377068ed12454314b7716d646a232b6a, user_id=20ff57439c3d4c1199e94802d39862b2, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:05.978568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:06.064255 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1137/2306] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:05 2022] PUT /identity/v3/projects/377068ed12454314b7716d646a232b6a/users/20ff57439c3d4c1199e94802d39862b2/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:06.075747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:06.076031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:06.076303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:06.107215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] MFA Rules not processed for user `20ff57439c3d4c1199e94802d39862b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:06.108413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:06.176514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1170/2307] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:06.187618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:06.189307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:06.245285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394b930-5d1d-48a3-8e75-9af7eaea8f9b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:06.248990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:06.249620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:06.249901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:06.250174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:06.258233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:06.259686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:06.268267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1138/2308] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:08.582440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:08.583924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:08.590136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:08.656707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04aa82-2f24-417a-8818-ea02bf398478 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:08.663168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72de48c-57cb-4560-aa76-f4f8c340100d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:08.663816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72de48c-57cb-4560-aa76-f4f8c340100d service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:08.667911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72de48c-57cb-4560-aa76-f4f8c340100d service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:08.667911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72de48c-57cb-4560-aa76-f4f8c340100d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:08.667911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a72de48c-57cb-4560-aa76-f4f8c340100d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:08.678945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72de48c-57cb-4560-aa76-f4f8c340100d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:08.680537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72de48c-57cb-4560-aa76-f4f8c340100d service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:08.692129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1171/2309] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:13.374085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:13.386476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:13.439571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0db29-203b-4109-aad1-24a7c68fa39d service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:13.444169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:13.444871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:13.445277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:13.445604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] PATH_INFO: `/v3/users/20ff57439c3d4c1199e94802d39862b2` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:13.446802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ff57439c3d4c1199e94802d39862b2)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:13.448787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:13.616404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ff57439c3d4c1199e94802d39862b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:13.617086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ff57439c3d4c1199e94802d39862b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:13.624921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ff57439c3d4c1199e94802d39862b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:13.636824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ff57439c3d4c1199e94802d39862b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:13.638347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ff57439c3d4c1199e94802d39862b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:13.736414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1139/2310] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:13 2022] DELETE /identity/v3/users/20ff57439c3d4c1199e94802d39862b2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:13.736784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:13.736784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:13.736784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:13.765487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:13.766755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:13.838315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1172/2311] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:13.848269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:13.849744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:13.909961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d124a-519e-4cc3-b225-8495b8c8f78c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:13.913539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948e0ce-3175-448f-8906-1865483b310e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:13.914138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e0ce-3175-448f-8906-1865483b310e service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:13.914413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e0ce-3175-448f-8906-1865483b310e service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:13.914683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e0ce-3175-448f-8906-1865483b310e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:13.925116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948e0ce-3175-448f-8906-1865483b310e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:13.926603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948e0ce-3175-448f-8906-1865483b310e service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:13.936451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1140/2312] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:14.421109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:14.423691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:14.436208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb401-7b7b-4137-a9d3-429dcf5c73e2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:14.440879 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:14.441541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:14.441818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:14.442090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] PATH_INFO: `/v3/projects/377068ed12454314b7716d646a232b6a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:14.443213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=377068ed12454314b7716d646a232b6a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:14.445240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:14.538210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377068ed12454314b7716d646a232b6a', 'request_id': 'req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:14.543953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377068ed12454314b7716d646a232b6a', 'request_id': 'req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:14.550801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377068ed12454314b7716d646a232b6a', 'request_id': 'req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:14.640581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] The token cache is being invalidate because project 377068ed12454314b7716d646a232b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:14.640891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:14.641536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d2719d9-3c33-42e2-8879-bbfdb2f8d7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:14.643087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1173/2313] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:14 2022] DELETE /identity/v3/projects/377068ed12454314b7716d646a232b6a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:14.648112 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec02db-fca8-4ec7-a36f-d59b39626a05 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:14.648584 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec02db-fca8-4ec7-a36f-d59b39626a05 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:14.648681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec02db-fca8-4ec7-a36f-d59b39626a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:14.671502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-88ec02db-fca8-4ec7-a36f-d59b39626a05 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:14.672704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-88ec02db-fca8-4ec7-a36f-d59b39626a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:14.703656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:14.733194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1141/2314] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:14.741229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105f443-3b3e-4683-bf12-ee8f1e3de47c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:14.743095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105f443-3b3e-4683-bf12-ee8f1e3de47c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:14.743095 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105f443-3b3e-4683-bf12-ee8f1e3de47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:14.762252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7105f443-3b3e-4683-bf12-ee8f1e3de47c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:14.763502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7105f443-3b3e-4683-bf12-ee8f1e3de47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:14.772146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1174/2315] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:14.775593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec02db-fca8-4ec7-a36f-d59b39626a05 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:14.785158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec02db-fca8-4ec7-a36f-d59b39626a05 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:14.789868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:14.790469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:14.790749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:14.791015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:14.791695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:14.791999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:14.794157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:14.806423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1142/2316] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:14.811555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105f443-3b3e-4683-bf12-ee8f1e3de47c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:14.821057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105f443-3b3e-4683-bf12-ee8f1e3de47c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:14.826000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:14.826602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:14.826878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:14.827150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:14.827792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:14.829757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:14.834426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:14.923804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1175/2317] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:14 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:14.928233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:14.938772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f392-c5e8-4dcd-976a-6af1dbbce194 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:14.995880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:14.996488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:14.996801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:14.997135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:14.997920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:14.999883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:15.127479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1143/2318] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:14 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:15.135633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:15.154553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8b12f-b131-4cef-bbce-2c02823c0e23 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:15.154553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:15.154553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:15.154553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:15.155012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:15.155012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:15.155618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:15.168212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1176/2319] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:15.171506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:15.181819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3fac-46da-4c5a-a1ec-d79a3e5c36a9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:15.187293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca912a-69fa-4aac-b818-88545cfa00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:15.187891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca912a-69fa-4aac-b818-88545cfa00e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:15.188285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca912a-69fa-4aac-b818-88545cfa00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:15.188562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca912a-69fa-4aac-b818-88545cfa00e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:15.189231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca912a-69fa-4aac-b818-88545cfa00e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:15.190903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca912a-69fa-4aac-b818-88545cfa00e3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:15.204131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1144/2320] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:15.206748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:15.219574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcafc4-a4c1-4093-950b-bff558015daf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:15.223469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:15.224150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:15.224430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:15.224903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] PATH_INFO: `/v3/projects/46af1d95879245819a90d5835c5295c9/users/dca2239d495f453fb92767feb8eaa397/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:15.241901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46af1d95879245819a90d5835c5295c9, user_id=dca2239d495f453fb92767feb8eaa397, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:15.244877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:15.349900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1177/2321] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:15 2022] PUT /identity/v3/projects/46af1d95879245819a90d5835c5295c9/users/dca2239d495f453fb92767feb8eaa397/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:15.361727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:15.362019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:15.362292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:15.391314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] MFA Rules not processed for user `dca2239d495f453fb92767feb8eaa397`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:15.392535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:15.457597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1145/2322] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:15.469581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:15.471430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:15.532538 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3968fc-2560-4cb2-96f2-587d711e0978 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:15.536382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:15.536991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:15.537307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:15.537606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:15.546098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:15.547539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:15.556089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1178/2323] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:16.638711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:16.640231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:16.673247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:16.697648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc906d-a022-4b16-9f66-1776a76759e7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:16.701245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:16.701840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:16.702115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:16.702385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:16.704110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:16.767232 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:16.768713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:16.779842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1146/2324] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:17.583611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:17.585492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:17.601023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9596-e00a-433c-867d-b89019550e66 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:17.605071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7757c-b9b5-4e95-b316-b315d0b044f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:17.605682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7757c-b9b5-4e95-b316-b315d0b044f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:17.605983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7757c-b9b5-4e95-b316-b315d0b044f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:17.606755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7757c-b9b5-4e95-b316-b315d0b044f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:17.608605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a7a7757c-b9b5-4e95-b316-b315d0b044f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:17.661511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7757c-b9b5-4e95-b316-b315d0b044f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:17.662956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7757c-b9b5-4e95-b316-b315d0b044f2 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:17.687988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1179/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:20.140106 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:20.198101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e4a9-09a4-4672-9e1d-d40a2fe979a4 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:20.203848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:20.204238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:20.204519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:20.204842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] PATH_INFO: `/v3/users/dca2239d495f453fb92767feb8eaa397` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:20.206140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca2239d495f453fb92767feb8eaa397)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:20.208104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:20.465411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca2239d495f453fb92767feb8eaa397'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:20.468305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca2239d495f453fb92767feb8eaa397'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:20.485915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca2239d495f453fb92767feb8eaa397'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:20.502725 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca2239d495f453fb92767feb8eaa397'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:20.503703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca2239d495f453fb92767feb8eaa397'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:20.608108 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1147/2326] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:20 2022] DELETE /identity/v3/users/dca2239d495f453fb92767feb8eaa397 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:20.609978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:20.612260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:20.612606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:20.684113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:20.686347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:20.749603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:20.792788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1180/2327] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:20.806105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:20.807670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:20.823076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:20.937928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889c46-ed34-41be-9190-46d17d67063f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:20.941710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:20.942409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:20.942750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:20.943083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:20.952545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:20.954081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:20.964800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1148/2328] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:21.114396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:21.116304 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:21.143820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4f120-ee13-4373-8962-6f3099043fbe None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:21.152968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:21.154649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:21.155031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:21.155580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] PATH_INFO: `/v3/users/30517a4b639c4a76a8f194f910c19720` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:21.156963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30517a4b639c4a76a8f194f910c19720)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:21.159096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:21.406274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30517a4b639c4a76a8f194f910c19720'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:21.421949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30517a4b639c4a76a8f194f910c19720'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:21.504384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30517a4b639c4a76a8f194f910c19720'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:21.525863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30517a4b639c4a76a8f194f910c19720'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:21.528072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30517a4b639c4a76a8f194f910c19720'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:21.540102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1181/2329] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:21 2022] DELETE /identity/v3/users/30517a4b639c4a76a8f194f910c19720 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:21.736680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:21.742551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:21.767555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55428dce-6f43-4da0-9cde-de15746c559f service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:21.853262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:21.858446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:21.872846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:21.873690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:21.873951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:21.874314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] PATH_INFO: `/v3/projects/46af1d95879245819a90d5835c5295c9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:21.876840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb305c-4a4a-47b1-bb04-e4f704cfc042 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:21.882384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=46af1d95879245819a90d5835c5295c9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:21.886154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:21.887088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:21.887379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:21.888527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:21.889073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] PATH_INFO: `/v3/projects/5977e34b3819428487be28be492a9cc5` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:21.891014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5977e34b3819428487be28be492a9cc5)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:21.893966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.018500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5977e34b3819428487be28be492a9cc5', 'request_id': 'req-94268ed6-c7c3-46f7-a375-6137d9877426'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.021020 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46af1d95879245819a90d5835c5295c9', 'request_id': 'req-4d5eb769-233c-451e-a79b-f31cfae380ac'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.024485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5977e34b3819428487be28be492a9cc5', 'request_id': 'req-94268ed6-c7c3-46f7-a375-6137d9877426'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.031236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5977e34b3819428487be28be492a9cc5', 'request_id': 'req-94268ed6-c7c3-46f7-a375-6137d9877426'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.121450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46af1d95879245819a90d5835c5295c9', 'request_id': 'req-4d5eb769-233c-451e-a79b-f31cfae380ac'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.128427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46af1d95879245819a90d5835c5295c9', 'request_id': 'req-4d5eb769-233c-451e-a79b-f31cfae380ac'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.140126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] The token cache is being invalidate because project 46af1d95879245819a90d5835c5295c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:22.140444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.141157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.142820 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1149/2330] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:21 2022] DELETE /identity/v3/projects/46af1d95879245819a90d5835c5295c9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:22.143393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.144654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.154544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:22.206651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] The token cache is being invalidate because project 5977e34b3819428487be28be492a9cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:22.206988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.207648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-94268ed6-c7c3-46f7-a375-6137d9877426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.208862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb769-233c-451e-a79b-f31cfae380ac admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.209185 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1182/2331] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:21 2022] DELETE /identity/v3/projects/5977e34b3819428487be28be492a9cc5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:22.210365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c840-0815-4287-a77c-ab5588c6baa9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.210649 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c840-0815-4287-a77c-ab5588c6baa9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.211243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c840-0815-4287-a77c-ab5588c6baa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.213883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.214514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.214791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.215061 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] PATH_INFO: `/v3/users/47091634f81746e7b68d3e78746e2f53` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.216512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47091634f81746e7b68d3e78746e2f53)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.218502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.242194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7467c840-0815-4287-a77c-ab5588c6baa9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:22.243406 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7467c840-0815-4287-a77c-ab5588c6baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.252207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1183/2332] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:22.253401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8f824-0e04-423d-b99c-4364ac3046a5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.253683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8f824-0e04-423d-b99c-4364ac3046a5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.253955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8f824-0e04-423d-b99c-4364ac3046a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.273552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-94d8f824-0e04-423d-b99c-4364ac3046a5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:22.274665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94d8f824-0e04-423d-b99c-4364ac3046a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.282606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1184/2333] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:22.283762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a85c-fe7f-448e-aff3-d4d59ba3457e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.284042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a85c-fe7f-448e-aff3-d4d59ba3457e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.284311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5a85c-fe7f-448e-aff3-d4d59ba3457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.292416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:22.303745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-acb5a85c-fe7f-448e-aff3-d4d59ba3457e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:22.304920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-acb5a85c-fe7f-448e-aff3-d4d59ba3457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.313700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1185/2334] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:22.315978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb715-23fb-481f-897c-268773f74df5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.315978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb715-23fb-481f-897c-268773f74df5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.315978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb715-23fb-481f-897c-268773f74df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.333700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-36dfb715-23fb-481f-897c-268773f74df5 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:22.334867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-36dfb715-23fb-481f-897c-268773f74df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.342699 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1186/2335] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:22.343475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb715-23fb-481f-897c-268773f74df5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.352399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb715-23fb-481f-897c-268773f74df5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.357715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.358286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.358565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.358836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.359521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:22.359823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.361494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.373495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1187/2336] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:22.374377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.383624 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241d9d0-b362-4c50-8ff2-19ea81d40b4e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.388448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.389013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.389323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.389598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.390220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:22.390519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.392086 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.403077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47091634f81746e7b68d3e78746e2f53'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.404069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47091634f81746e7b68d3e78746e2f53'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.404637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1188/2337] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:22.405522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.407132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.411567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47091634f81746e7b68d3e78746e2f53'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.420945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a4a9-4d3f-4d14-8a51-7d444c56c0eb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.424956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47091634f81746e7b68d3e78746e2f53'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.425688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47091634f81746e7b68d3e78746e2f53'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.425803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.426313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.426587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.426855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.427474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.429482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.507079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1150/2338] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:22 2022] DELETE /identity/v3/users/47091634f81746e7b68d3e78746e2f53 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:22.507877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.509626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.518066 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1189/2339] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:22.527532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.580519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c0d-5df9-4aed-9e64-2676e983f17d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.600861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102e771-99bc-47b9-8da4-6c81d023edb8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.605855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.607371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.607658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.608027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.608553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.610567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.641371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.642010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.642345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.642620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.643337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.645347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.698339 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1190/2340] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:22.702531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.711940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20a6d-0af8-40d1-a4ee-26305e0c6b69 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.717500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.718082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.718360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.718626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.719250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.721281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.728709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1151/2341] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:22.732678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1191/2342] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:22.737641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.738135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.747347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfb5c-7a8f-414b-bd02-c5d7b46c7306 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.808365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.808994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.809500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.810440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.811091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.812140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11321334-eec9-4402-8414-be46b2d2fa29 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.813231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.817793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.818551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.818834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.819101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.819746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.822014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.826121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:22.836075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1152/2343] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:44:22.837253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.839038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:22.852544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398d76-6efb-44b9-9dcb-37c1b4e56b59 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.858238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.858979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.859260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.859551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] PATH_INFO: `/v3/projects/f7804157dc6e4bc0929eadb7d1632f73` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.860675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7804157dc6e4bc0929eadb7d1632f73)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.862694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.932714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1192/2344] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:22 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:22.933704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:22.943123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed400e7-0163-422b-a0d1-71674df0d960 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:22.947666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:22.948278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:22.948554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:22.948824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] PATH_INFO: `/v3/projects/46a3ae957974441bb8e670e0b1179867/users/03303e4b069f411290ed4e5b11504cf1/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:22.964300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a3ae957974441bb8e670e0b1179867, user_id=03303e4b069f411290ed4e5b11504cf1, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:22.967625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:22.976995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7804157dc6e4bc0929eadb7d1632f73', 'request_id': 'req-4c7a5775-c496-4cd6-a830-16ed7886b427'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:22.999182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:23.070247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1193/2345] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:22 2022] PUT /identity/v3/projects/46a3ae957974441bb8e670e0b1179867/users/03303e4b069f411290ed4e5b11504cf1/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:23.071004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.093815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7804157dc6e4bc0929eadb7d1632f73', 'request_id': 'req-4c7a5775-c496-4cd6-a830-16ed7886b427'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:23.099955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7804157dc6e4bc0929eadb7d1632f73', 'request_id': 'req-4c7a5775-c496-4cd6-a830-16ed7886b427'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:23.112554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] The token cache is being invalidate because project f7804157dc6e4bc0929eadb7d1632f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:23.112849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:23.113573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4c7a5775-c496-4cd6-a830-16ed7886b427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:23.115113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1153/2346] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:22 2022] DELETE /identity/v3/projects/f7804157dc6e4bc0929eadb7d1632f73 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:23.116300 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc7a7-94f5-4ba0-91ee-047c041e05de None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.116590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc7a7-94f5-4ba0-91ee-047c041e05de None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.116871 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc7a7-94f5-4ba0-91ee-047c041e05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.133968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c359be7-e2d0-4bb4-9ed0-c99e898dca4f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.139360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afca2f-549c-475d-95fe-a05accc7d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.139963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afca2f-549c-475d-95fe-a05accc7d6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.140245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afca2f-549c-475d-95fe-a05accc7d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.140543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afca2f-549c-475d-95fe-a05accc7d6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.141209 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afca2f-549c-475d-95fe-a05accc7d6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.142825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afca2f-549c-475d-95fe-a05accc7d6b6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.144343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-367dc7a7-94f5-4ba0-91ee-047c041e05de None None] MFA Rules not processed for user `03303e4b069f411290ed4e5b11504cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:23.145580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-367dc7a7-94f5-4ba0-91ee-047c041e05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:23.152641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1194/2347] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:23.154661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.154950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.155223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.174344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:23.175549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:23.184351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1195/2348] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:23.185518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.186772 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:23.199021 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad832c2-b05d-4a31-bca0-ff4fccac269c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.204655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.205296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.205576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.205847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.206515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.208123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.212031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1154/2349] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:23.213728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a345-a1be-46d4-9cf6-06815d3d6197 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.213913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a345-a1be-46d4-9cf6-06815d3d6197 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.214286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a345-a1be-46d4-9cf6-06815d3d6197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.222212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1196/2350] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:23.222212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.222212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:23.234961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9c027-3ff0-4d28-b35e-213fa15f1912 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.235267 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9ea2a345-a1be-46d4-9cf6-06815d3d6197 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:23.237281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9ea2a345-a1be-46d4-9cf6-06815d3d6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:23.239486 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.240075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.240357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.240633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.241291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.243164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.244759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1155/2351] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:23.245570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2a345-a1be-46d4-9cf6-06815d3d6197 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.255265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2a345-a1be-46d4-9cf6-06815d3d6197 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.259877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.260520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.260799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.261104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] PATH_INFO: `/v3/projects/402455e110c64da3a8c362de6eee7e42/users/3b274d2701dd47669cd2768794eec39d/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.276099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402455e110c64da3a8c362de6eee7e42, user_id=3b274d2701dd47669cd2768794eec39d, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.278817 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.357199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1197/2352] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:23.358989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.407701 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:23.414576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1156/2353] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:23 2022] PUT /identity/v3/projects/402455e110c64da3a8c362de6eee7e42/users/3b274d2701dd47669cd2768794eec39d/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:23.415207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.418751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070576f-8c21-4dd3-bd72-0eb1dba74b58 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.468552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:23.478071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dc614-a2a8-4d36-a777-2a6268408479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.478245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30652d-ba69-402d-9aaa-96a2e566ab96 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.478734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc614-a2a8-4d36-a777-2a6268408479 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.479024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc614-a2a8-4d36-a777-2a6268408479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.479323 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc614-a2a8-4d36-a777-2a6268408479 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.480056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc614-a2a8-4d36-a777-2a6268408479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:23.480385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc614-a2a8-4d36-a777-2a6268408479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.481999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc614-a2a8-4d36-a777-2a6268408479 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.484458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.485548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.486211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.486710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.487942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.491931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.493454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1198/2354] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:23.494671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b7e67-32f0-482c-880b-c5ba798a9bf4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.494958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b7e67-32f0-482c-880b-c5ba798a9bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.497345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b7e67-32f0-482c-880b-c5ba798a9bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.523931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-dd6b7e67-32f0-482c-880b-c5ba798a9bf4 None None] MFA Rules not processed for user `3b274d2701dd47669cd2768794eec39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:23.525214 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-dd6b7e67-32f0-482c-880b-c5ba798a9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:23.586857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1199/2355] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:23.587576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b7e67-32f0-482c-880b-c5ba798a9bf4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.595710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1157/2356] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:23.599970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.600087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b7e67-32f0-482c-880b-c5ba798a9bf4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.604248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.604851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.605166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.605453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.606079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.607097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac748-c6dd-4a04-825c-f791f015bfa6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.608478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.611903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.612495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.612768 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.613050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.613713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.615592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.699507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1158/2357] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:23.700500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.702814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1200/2358] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:23.703729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.765250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea23d-c9f6-4311-a9a3-c9546a9eed02 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.766662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e62e25-a998-4ad8-94b6-52df4854e23d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.769959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.770593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.770874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.771148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.771353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.771790 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.772000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.772309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.772587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.773251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.773430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.775161 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.783731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1159/2359] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:23.784523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.789382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:23.795121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b007d5d-c17e-4a3e-b569-213c2b68dd16 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.799727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.800296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.800858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.800858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.801550 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.803442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.874036 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1201/2360] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:23.874869 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.884520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd849ab-c601-4f71-9ec0-9e80665805a6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.888081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1160/2361] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:23 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:23.888992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.892732 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.893373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.893656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.893928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.894625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.896203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.898391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a79d-4165-4b90-8a80-fc3b4fd7481d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.902975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.904384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.904384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.904384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.904762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.906367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.906661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1202/2362] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:23.907581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.917000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124f90-db0f-4632-9eb1-f1c69da60329 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.917187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1161/2363] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:23.917987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.922940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.923527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.923808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.924081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.924723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.926361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.928505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf76de-9255-4111-909a-43ba39d7ef26 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.933115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.933751 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.934066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.934342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] PATH_INFO: `/v3/projects/e4fe7824104f46b4a48cee4259658e35/users/d2388884aa1f4d4686d8c74eb1c65174/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.938962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1203/2364] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:23.939836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.949864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16714d1-a243-429d-aec2-f631dab3fb62 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.950467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fe7824104f46b4a48cee4259658e35, user_id=d2388884aa1f4d4686d8c74eb1c65174, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.953095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.954501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.955080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.955356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.955635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.956260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:23.957844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:23.968224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1204/2365] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:23.969000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:23.978534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c930e-ddfd-48a4-ac34-51f0a1bda332 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:23.984490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71940ad-c8fe-4036-9e91-785f88daaf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:23.985129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71940ad-c8fe-4036-9e91-785f88daaf15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:23.985405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71940ad-c8fe-4036-9e91-785f88daaf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:23.985672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71940ad-c8fe-4036-9e91-785f88daaf15 admin admin] PATH_INFO: `/v3/projects/62dcf162f1a44f5a8329404b16abdcce/users/f1e36cce00854e58a874f7e7c3c29d98/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:23.988594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:23.999791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71940ad-c8fe-4036-9e91-785f88daaf15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dcf162f1a44f5a8329404b16abdcce, user_id=f1e36cce00854e58a874f7e7c3c29d98, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.002423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71940ad-c8fe-4036-9e91-785f88daaf15 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.016269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1162/2366] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:23 2022] PUT /identity/v3/projects/e4fe7824104f46b4a48cee4259658e35/users/d2388884aa1f4d4686d8c74eb1c65174/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:24.017172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.078029 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607b1c-0891-42e3-b994-fabfdbc23587 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.082692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.085479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.085479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.085479 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] PATH_INFO: `/v3/projects/3d54581bd7b54769af94ca911e9606d8/users/47680d7bd2444c5bb220a68245891318/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.098486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d54581bd7b54769af94ca911e9606d8, user_id=47680d7bd2444c5bb220a68245891318, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.101171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.111024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1205/2367] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:23 2022] PUT /identity/v3/projects/62dcf162f1a44f5a8329404b16abdcce/users/f1e36cce00854e58a874f7e7c3c29d98/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:24.112317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b82e6-5b5b-49bd-ac33-629425a0b651 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.112601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b82e6-5b5b-49bd-ac33-629425a0b651 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.117611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b82e6-5b5b-49bd-ac33-629425a0b651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.140098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-955b82e6-5b5b-49bd-ac33-629425a0b651 None None] MFA Rules not processed for user `d2388884aa1f4d4686d8c74eb1c65174`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:24.143119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-955b82e6-5b5b-49bd-ac33-629425a0b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:24.203764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1206/2368] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:24.205438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b82e6-5b5b-49bd-ac33-629425a0b651 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.212800 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1163/2369] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:24 2022] PUT /identity/v3/projects/3d54581bd7b54769af94ca911e9606d8/users/47680d7bd2444c5bb220a68245891318/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:24.213596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.276510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b82e6-5b5b-49bd-ac33-629425a0b651 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.277438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c83e5-43a4-49e8-aa1c-482e4d6eb5ce admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.282090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b5483-e09d-4e1c-bd2e-05a97afe0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.282776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5483-e09d-4e1c-bd2e-05a97afe0337 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.283128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5483-e09d-4e1c-bd2e-05a97afe0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.283244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.283536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5483-e09d-4e1c-bd2e-05a97afe0337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.283741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.284021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.284289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.284450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5483-e09d-4e1c-bd2e-05a97afe0337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.284912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.286191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5483-e09d-4e1c-bd2e-05a97afe0337 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.286827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.300257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1207/2370] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:24.300257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26df65-2663-4556-93e0-eed67226d896 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.300257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26df65-2663-4556-93e0-eed67226d896 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.300257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26df65-2663-4556-93e0-eed67226d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.325653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8c26df65-2663-4556-93e0-eed67226d896 None None] MFA Rules not processed for user `47680d7bd2444c5bb220a68245891318`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:24.326947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8c26df65-2663-4556-93e0-eed67226d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:24.386460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:24.390986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1208/2371] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:24.391842 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26df65-2663-4556-93e0-eed67226d896 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.401888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26df65-2663-4556-93e0-eed67226d896 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.407756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.408401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.408677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.408940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] PATH_INFO: `/v3/projects/62dcf162f1a44f5a8329404b16abdcce/users/f1e36cce00854e58a874f7e7c3c29d98/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.410830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dcf162f1a44f5a8329404b16abdcce, user_id=f1e36cce00854e58a874f7e7c3c29d98, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.413532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.418924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1164/2372] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:24 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:24.418924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.418924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:24.425686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1209/2373] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:24 2022] PUT /identity/v3/projects/62dcf162f1a44f5a8329404b16abdcce/users/f1e36cce00854e58a874f7e7c3c29d98/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:24.426482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.442173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:24.492398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6549-46a0-4a96-8a67-b3744d25102d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.497197 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb65e8-b716-4054-a51a-7df44fb96c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.497807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb65e8-b716-4054-a51a-7df44fb96c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.498372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb65e8-b716-4054-a51a-7df44fb96c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.498621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb65e8-b716-4054-a51a-7df44fb96c35 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.499260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb65e8-b716-4054-a51a-7df44fb96c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.501212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb65e8-b716-4054-a51a-7df44fb96c35 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.502123 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bbb26-2db5-4c3b-95fb-e26b3b742f5f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.552897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.553574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.553873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.554133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.589551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1210/2374] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:24 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:24.592273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.592767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.593235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.610132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.611656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.620528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1165/2375] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:24.621168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] MFA Rules not processed for user `f1e36cce00854e58a874f7e7c3c29d98`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:24.621417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.623061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:24.632036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23106f7-b255-4f47-853a-9deba5b74da1 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.636938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.638072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.638668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.638953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.639693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.641398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.651804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1166/2376] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:24.656573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.668867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95034af-b529-42fb-9815-cd9feddfadd8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.675798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.676692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.677075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.677432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] PATH_INFO: `/v3/projects/0f600a6aa40b4a68a3b0ffe524885f95/users/527e69a201914d6098bda2e3be044e9e/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.695242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f600a6aa40b4a68a3b0ffe524885f95, user_id=527e69a201914d6098bda2e3be044e9e, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.698571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.703395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1211/2377] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:24.715047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.717331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:24.729222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f872b-2088-4d32-899c-393ffef274f9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.733484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.734114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.734394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.734668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.744009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.745475 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.755526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1212/2378] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:24.786703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.797751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1d31c-df72-4cae-bd7c-81ae7e704472 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.802311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.802926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.803205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.803477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] PATH_INFO: `/v3/users/3b274d2701dd47669cd2768794eec39d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.804589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b274d2701dd47669cd2768794eec39d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.806560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.814575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1167/2379] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:24 2022] PUT /identity/v3/projects/0f600a6aa40b4a68a3b0ffe524885f95/users/527e69a201914d6098bda2e3be044e9e/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:24.818794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.856434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:24.886655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4b64-849c-4147-9c55-a6b86c3ac517 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.892442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.892989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.893309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.893580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.894219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.895813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.906295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1168/2380] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:44:24.910322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:24.919574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22414-2aba-4f90-8b7c-eb6a701a7146 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:24.924874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b4e04-abad-4d0d-b6d2-4807eaa8eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:24.925978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4e04-abad-4d0d-b6d2-4807eaa8eb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.926307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4e04-abad-4d0d-b6d2-4807eaa8eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.926630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b4e04-abad-4d0d-b6d2-4807eaa8eb8f admin admin] PATH_INFO: `/v3/projects/0f600a6aa40b4a68a3b0ffe524885f95/users/527e69a201914d6098bda2e3be044e9e/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.928670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4e04-abad-4d0d-b6d2-4807eaa8eb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f600a6aa40b4a68a3b0ffe524885f95, user_id=527e69a201914d6098bda2e3be044e9e, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:24.931289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b4e04-abad-4d0d-b6d2-4807eaa8eb8f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:24.943095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1169/2381] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:24 2022] PUT /identity/v3/projects/0f600a6aa40b4a68a3b0ffe524885f95/users/527e69a201914d6098bda2e3be044e9e/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:24.953662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c4e8c-364c-4fe8-96e7-8a48fe0de247 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:24.953974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c4e8c-364c-4fe8-96e7-8a48fe0de247 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:24.954250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c4e8c-364c-4fe8-96e7-8a48fe0de247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:24.982022 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-374c4e8c-364c-4fe8-96e7-8a48fe0de247 None None] MFA Rules not processed for user `527e69a201914d6098bda2e3be044e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:24.982495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:24.983291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-374c4e8c-364c-4fe8-96e7-8a48fe0de247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:24.985211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b274d2701dd47669cd2768794eec39d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:24.992490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b274d2701dd47669cd2768794eec39d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:25.052807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1170/2382] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:25.064635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c4e8c-364c-4fe8-96e7-8a48fe0de247 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:25.073616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b274d2701dd47669cd2768794eec39d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:25.088903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b274d2701dd47669cd2768794eec39d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:25.089672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d0f2f1b2-c7c6-4c23-bc9c-e409dccfb25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b274d2701dd47669cd2768794eec39d'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:25.096305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1213/2383] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:24 2022] DELETE /identity/v3/users/3b274d2701dd47669cd2768794eec39d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:25.100708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:25.101140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:25.101551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:25.121135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c4e8c-364c-4fe8-96e7-8a48fe0de247 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:25.126903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:25.126903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:25.173066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:25.173658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:25.173939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:25.174207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:25.176218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:25.182845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1214/2384] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:25.189646 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:25.196993 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:25.198581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:25.241321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:25.242925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:25.252764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1171/2385] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:25.259069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f734a-40a5-4c4c-916f-4cd9a43a9c57 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:25.264438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:25.264438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:25.264438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:25.264438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:25.275484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:25.277376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:25.296537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1215/2386] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:25.745471 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:25.746979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:25.762334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b23001-4dbc-4111-bc71-99bad26a986a service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:25.768090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:25.768730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:25.769097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:25.769374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] PATH_INFO: `/v3/projects/402455e110c64da3a8c362de6eee7e42` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:25.771186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=402455e110c64da3a8c362de6eee7e42)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:25.772546 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:25.923995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402455e110c64da3a8c362de6eee7e42', 'request_id': 'req-d2616764-e64f-46a7-91c1-818b2b02ca8b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.000363 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402455e110c64da3a8c362de6eee7e42', 'request_id': 'req-d2616764-e64f-46a7-91c1-818b2b02ca8b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.005521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402455e110c64da3a8c362de6eee7e42', 'request_id': 'req-d2616764-e64f-46a7-91c1-818b2b02ca8b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.018409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] The token cache is being invalidate because project 402455e110c64da3a8c362de6eee7e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:26.018691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.019366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.021114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1172/2387] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:25 2022] DELETE /identity/v3/projects/402455e110c64da3a8c362de6eee7e42 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:26.025151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:26.035450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bef61-1381-49a4-a8e6-39fb3777f3ea service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:26.093494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:26.094220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:26.094503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:26.094779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] PATH_INFO: `/v3/users/f1e36cce00854e58a874f7e7c3c29d98` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:26.095913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e36cce00854e58a874f7e7c3c29d98)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:26.097899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:26.102520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:26.346326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e36cce00854e58a874f7e7c3c29d98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.353052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e36cce00854e58a874f7e7c3c29d98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.446912 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e36cce00854e58a874f7e7c3c29d98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.460617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e36cce00854e58a874f7e7c3c29d98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.461648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-543d8762-b536-41b2-a90e-5bb427af9100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e36cce00854e58a874f7e7c3c29d98'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:26.469052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1216/2388] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:26 2022] DELETE /identity/v3/users/f1e36cce00854e58a874f7e7c3c29d98 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:26.911599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:26.913483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:26.929898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2616764-e64f-46a7-91c1-818b2b02ca8b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.006839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.008988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.008988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.008988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] PATH_INFO: `/v3/projects/62dcf162f1a44f5a8329404b16abdcce` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.009506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dcf162f1a44f5a8329404b16abdcce)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.012761 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:27.134581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:27.143799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dcf162f1a44f5a8329404b16abdcce', 'request_id': 'req-a2df2a71-5e72-4873-913f-b89de3dd352c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:27.227155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dcf162f1a44f5a8329404b16abdcce', 'request_id': 'req-a2df2a71-5e72-4873-913f-b89de3dd352c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:27.233926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dcf162f1a44f5a8329404b16abdcce', 'request_id': 'req-a2df2a71-5e72-4873-913f-b89de3dd352c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:27.245218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] The token cache is being invalidate because project 62dcf162f1a44f5a8329404b16abdcce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:27.245538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:27.246193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a2df2a71-5e72-4873-913f-b89de3dd352c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:27.247664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1173/2389] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:26 2022] DELETE /identity/v3/projects/62dcf162f1a44f5a8329404b16abdcce => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:27.253153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c91ba-ebfb-4817-94b8-f207ec470434 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.253627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c91ba-ebfb-4817-94b8-f207ec470434 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.253848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c91ba-ebfb-4817-94b8-f207ec470434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.274859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8e9c91ba-ebfb-4817-94b8-f207ec470434 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:27.276094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e9c91ba-ebfb-4817-94b8-f207ec470434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:27.349335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1217/2390] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:27.360377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea2747-e32f-4db0-9f89-8f498d5c3a0e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.360943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea2747-e32f-4db0-9f89-8f498d5c3a0e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.361299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea2747-e32f-4db0-9f89-8f498d5c3a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.382973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-adea2747-e32f-4db0-9f89-8f498d5c3a0e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:27.384627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-adea2747-e32f-4db0-9f89-8f498d5c3a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:27.398051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1174/2391] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:27.402540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c91ba-ebfb-4817-94b8-f207ec470434 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:27.413404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c91ba-ebfb-4817-94b8-f207ec470434 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.418484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.419108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.419415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.419652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.420614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:27.420877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.422523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:27.437301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1218/2392] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:27.442671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea2747-e32f-4db0-9f89-8f498d5c3a0e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:27.455001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea2747-e32f-4db0-9f89-8f498d5c3a0e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.460616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.461250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.461530 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.461959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.462750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.464913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:27.540219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:27.542205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:27.603148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfe546-0fec-45cb-a17b-7321c31086f1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.606715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.607316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.607589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.607858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.609574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:27.634187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:27.652250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1175/2393] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:27 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:27.657015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:27.669078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.670828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:27.679743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1219/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:27.722692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04a408-940b-4437-83fb-dde4d52d2d6f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.727347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.727938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.728218 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.728487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.729137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.731058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:27.818723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1176/2395] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:27 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:27.822853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:27.834640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a598a-ea0d-4e88-90b6-98f633614dc9 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.839215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.839809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.840085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.840355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.841193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.842768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:27.856296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1220/2396] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:27.857973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:27.868311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb88dd-23e8-4cf7-9a95-591e444b15f7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.874273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ed937-e0b5-4cb1-9ffc-41f2faa5586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.874878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ed937-e0b5-4cb1-9ffc-41f2faa5586e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.875181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ed937-e0b5-4cb1-9ffc-41f2faa5586e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.875459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ed937-e0b5-4cb1-9ffc-41f2faa5586e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.876096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ed937-e0b5-4cb1-9ffc-41f2faa5586e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.877774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ed937-e0b5-4cb1-9ffc-41f2faa5586e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:27.887764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1177/2397] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:27.892761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:27.902590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d39ff-a218-4a02-a3b8-16263fbdad22 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:27.907867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:27.911254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:27.911254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:27.911254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] PATH_INFO: `/v3/projects/ee133195f6314f6db07e737b7c2a5161/users/bafd90ec19ae4c0e8c09cc7c251ccc4d/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:27.924091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee133195f6314f6db07e737b7c2a5161, user_id=bafd90ec19ae4c0e8c09cc7c251ccc4d, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:27.926800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.019614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1221/2398] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:27 2022] PUT /identity/v3/projects/ee133195f6314f6db07e737b7c2a5161/users/bafd90ec19ae4c0e8c09cc7c251ccc4d/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:28.030095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154f44-c029-4732-b1ea-d2b55a2ff06c None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.030568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154f44-c029-4732-b1ea-d2b55a2ff06c None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.031783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154f44-c029-4732-b1ea-d2b55a2ff06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.059075 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-2b154f44-c029-4732-b1ea-d2b55a2ff06c None None] MFA Rules not processed for user `bafd90ec19ae4c0e8c09cc7c251ccc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:28.060803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2b154f44-c029-4732-b1ea-d2b55a2ff06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:28.133245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1178/2399] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:28.144146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:28.208019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e80c-676d-4e97-bd05-ee400936c917 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:28.212864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:28.215361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.215361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.215361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.215361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:28.216628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.308911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1222/2400] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:28 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:28.314416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154f44-c029-4732-b1ea-d2b55a2ff06c None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:28.321339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:28.325287 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154f44-c029-4732-b1ea-d2b55a2ff06c None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:28.382976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:28.383614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.383943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.384191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.384821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:28.386811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.471361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1179/2401] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:28 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:28.475490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:28.486535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6d7a0-f101-49be-aa3b-9dea98e9c930 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:28.491152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:28.491746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.492023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.492295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.492933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:28.494743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.507587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1223/2402] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:28.511630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:28.524711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7ef3-f2b7-441d-81b5-8e71b2a55214 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:28.530290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:28.530961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.531244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.531520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] PATH_INFO: `/v3/projects/c625679c1e2847c7a4037b8d5805a0ac/users/126c78be8c4a42858c81b8a724a560cd/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.547490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c625679c1e2847c7a4037b8d5805a0ac, user_id=126c78be8c4a42858c81b8a724a560cd, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:28.550210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.626180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1180/2403] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:28 2022] PUT /identity/v3/projects/c625679c1e2847c7a4037b8d5805a0ac/users/126c78be8c4a42858c81b8a724a560cd/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:28.630295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:28.640306 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac57f5-39c4-441c-acf6-3f5e27534222 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:28.695589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db7e93-44c9-4ef0-8e5c-0c31dceb29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:28.696188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db7e93-44c9-4ef0-8e5c-0c31dceb29bf admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.696464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db7e93-44c9-4ef0-8e5c-0c31dceb29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.696734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db7e93-44c9-4ef0-8e5c-0c31dceb29bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.697395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db7e93-44c9-4ef0-8e5c-0c31dceb29bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:28.698961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db7e93-44c9-4ef0-8e5c-0c31dceb29bf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.703920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:28.708840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1224/2404] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:28.712995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:28.725414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390c1e-4861-4876-b321-07c85fed6ffe admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:28.732677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:28.737723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.737723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.737723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] PATH_INFO: `/v3/projects/c625679c1e2847c7a4037b8d5805a0ac/users/126c78be8c4a42858c81b8a724a560cd/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.737723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c625679c1e2847c7a4037b8d5805a0ac, user_id=126c78be8c4a42858c81b8a724a560cd, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:28.738977 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.755304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1181/2405] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:28 2022] PUT /identity/v3/projects/c625679c1e2847c7a4037b8d5805a0ac/users/126c78be8c4a42858c81b8a724a560cd/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:28.771118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4136bb-dcd3-4321-b93a-87b3da3819f5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.771403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4136bb-dcd3-4321-b93a-87b3da3819f5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.771930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4136bb-dcd3-4321-b93a-87b3da3819f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.812797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0e4136bb-dcd3-4321-b93a-87b3da3819f5 None None] MFA Rules not processed for user `126c78be8c4a42858c81b8a724a560cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:28.813065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0e4136bb-dcd3-4321-b93a-87b3da3819f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:28.891240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1225/2406] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:28.904193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:28.905877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:28.963537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881d633-9ec6-497f-9ca8-b60ff3d7a205 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:28.967939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:28.972111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:28.972111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:28.972111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:28.978450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:28.979946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:28.989414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1182/2407] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:29.180400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4136bb-dcd3-4321-b93a-87b3da3819f5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:29.190665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4136bb-dcd3-4321-b93a-87b3da3819f5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:29.194282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:29.202258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:29.202258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:29.202258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:29.202258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:29.271805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:29.276826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:29.283984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1226/2408] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:30.235609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:30.235609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316f4d-3f7a-4e30-a585-4ae3ba00bb7a service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:30.240242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126c78be8c4a42858c81b8a724a560cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c625679c1e2847c7a4037b8d5805a0ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:30.240876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:30.241194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:30.241474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:30.242117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:30.242426 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:30.244110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:30.257361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1183/2409] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:30.261651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:30.273592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9b69-c29c-4d29-8f71-f2d30522e4c4 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:30.278668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126c78be8c4a42858c81b8a724a560cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c625679c1e2847c7a4037b8d5805a0ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:30.279532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:30.279882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:30.280230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:30.280932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:30.283071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:30.392173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1227/2410] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:30 2022] POST /identity/v3/projects => generated 353 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:30.396339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:30.407007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb85f32-1844-447f-ad0a-4d65b772aa7b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:30.453233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:30.466006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126c78be8c4a42858c81b8a724a560cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c625679c1e2847c7a4037b8d5805a0ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:30.467278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:30.467563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:30.468028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:30.468931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:30.469309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:30.470913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:30.483200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1184/2411] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:30.521488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:30.532195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0df5f4-b5f9-4e6b-b421-44de5ccb891b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:30.541389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '126c78be8c4a42858c81b8a724a560cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c625679c1e2847c7a4037b8d5805a0ac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:30.541389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:30.541389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:30.541782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] PATH_INFO: `/v3/projects/8191ae595fab4e61a4c8e8cb492decdb` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:30.541782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8191ae595fab4e61a4c8e8cb492decdb)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:30.541782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:30.666633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8191ae595fab4e61a4c8e8cb492decdb', 'request_id': 'req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:30.670762 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:30.674862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8191ae595fab4e61a4c8e8cb492decdb', 'request_id': 'req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:30.681901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8191ae595fab4e61a4c8e8cb492decdb', 'request_id': 'req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:30.776151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] The token cache is being invalidate because project 8191ae595fab4e61a4c8e8cb492decdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:30.777083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:30.778679 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-2087abf9-d2e6-4f57-adf8-aa8a6dafcfc9 tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:30.781695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1228/2412] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:30 2022] DELETE /identity/v3/projects/8191ae595fab4e61a4c8e8cb492decdb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:31.730765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:31.732726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:31.798631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6508-98e7-4dec-837b-e8934c12400b tempest-VolumeQuotaClassesTest-1205872514 tempest-VolumeQuotaClassesTest-1205872514-project-admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:31.854944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:31.855579 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:31.855862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:31.856137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] PATH_INFO: `/v3/users/bafd90ec19ae4c0e8c09cc7c251ccc4d` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:31.857990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafd90ec19ae4c0e8c09cc7c251ccc4d)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:31.859932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:32.018186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafd90ec19ae4c0e8c09cc7c251ccc4d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:32.018903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafd90ec19ae4c0e8c09cc7c251ccc4d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:32.026179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafd90ec19ae4c0e8c09cc7c251ccc4d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:32.038617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafd90ec19ae4c0e8c09cc7c251ccc4d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:32.039264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafd90ec19ae4c0e8c09cc7c251ccc4d'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:32.101113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1185/2413] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:31 2022] DELETE /identity/v3/users/bafd90ec19ae4c0e8c09cc7c251ccc4d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:32.105510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:32.105985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:32.106091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:32.125929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:32.127114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:32.187234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1229/2414] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:32.199905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:32.205518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:32.213024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:32.263847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12f2c5-a9f2-48e3-b99b-e268c30d02ab admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:32.267442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:32.268038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:32.268387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:32.268660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:32.277604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:32.279247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:32.289101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1186/2415] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:32.788181 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:32.790018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:32.813279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5517f2-204c-4586-a27b-d2a0d76e549e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:32.818633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:32.819301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:32.819578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:32.819855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] PATH_INFO: `/v3/projects/ee133195f6314f6db07e737b7c2a5161` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:32.820971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee133195f6314f6db07e737b7c2a5161)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:32.822923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:32.951147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee133195f6314f6db07e737b7c2a5161', 'request_id': 'req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:32.956545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee133195f6314f6db07e737b7c2a5161', 'request_id': 'req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:32.962980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee133195f6314f6db07e737b7c2a5161', 'request_id': 'req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.047324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] The token cache is being invalidate because project ee133195f6314f6db07e737b7c2a5161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:33.047621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.048252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.049781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1230/2416] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:32 2022] DELETE /identity/v3/projects/ee133195f6314f6db07e737b7c2a5161 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:33.053760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:33.064846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0a090-7b80-40dc-811e-d9d4bd820086 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:33.123968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:33.124594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:33.124878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:33.125195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] PATH_INFO: `/v3/users/126c78be8c4a42858c81b8a724a560cd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:33.126330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126c78be8c4a42858c81b8a724a560cd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:33.128269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:33.381534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126c78be8c4a42858c81b8a724a560cd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.382174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126c78be8c4a42858c81b8a724a560cd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.389139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126c78be8c4a42858c81b8a724a560cd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.401933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126c78be8c4a42858c81b8a724a560cd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.404964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126c78be8c4a42858c81b8a724a560cd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:33.475981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1187/2417] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:33 2022] DELETE /identity/v3/users/126c78be8c4a42858c81b8a724a560cd => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:33.903243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:33.904697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:33.918269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e36458-ac2a-4be7-b08d-ec6bc88f69ba admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:33.977576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:33.978234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:33.978536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:33.978847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] PATH_INFO: `/v3/projects/c625679c1e2847c7a4037b8d5805a0ac` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:33.979964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c625679c1e2847c7a4037b8d5805a0ac)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:33.981905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:33.989301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:34.134081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c625679c1e2847c7a4037b8d5805a0ac', 'request_id': 'req-d700088d-82a6-4496-8d12-6f04fd5869bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.139755 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c625679c1e2847c7a4037b8d5805a0ac', 'request_id': 'req-d700088d-82a6-4496-8d12-6f04fd5869bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.147247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c625679c1e2847c7a4037b8d5805a0ac', 'request_id': 'req-d700088d-82a6-4496-8d12-6f04fd5869bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.161867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.163466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:34.177249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc66d03-ca15-40fd-bdac-294a0be75ee6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.202511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:34.232304 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.232928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.233975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.237383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] PATH_INFO: `/v3/users/03303e4b069f411290ed4e5b11504cf1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.237383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03303e4b069f411290ed4e5b11504cf1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.237383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.302219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] The token cache is being invalidate because project c625679c1e2847c7a4037b8d5805a0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:34.302518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.303118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d700088d-82a6-4496-8d12-6f04fd5869bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.304638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1231/2418] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:33 2022] DELETE /identity/v3/projects/c625679c1e2847c7a4037b8d5805a0ac => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:34.309448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594320f5-37ed-42b2-a0f1-c4a7dec1932e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.309727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594320f5-37ed-42b2-a0f1-c4a7dec1932e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.310019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594320f5-37ed-42b2-a0f1-c4a7dec1932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.329954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-594320f5-37ed-42b2-a0f1-c4a7dec1932e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:34.331162 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-594320f5-37ed-42b2-a0f1-c4a7dec1932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:34.339166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1232/2419] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:34.347076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7af6b-735e-4c62-bb08-5af0a032f773 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.347358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7af6b-735e-4c62-bb08-5af0a032f773 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.352435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7af6b-735e-4c62-bb08-5af0a032f773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.367570 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-acb7af6b-735e-4c62-bb08-5af0a032f773 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:34.368730 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-acb7af6b-735e-4c62-bb08-5af0a032f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:34.376575 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1233/2420] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:34.380648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7af6b-735e-4c62-bb08-5af0a032f773 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.389230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7af6b-735e-4c62-bb08-5af0a032f773 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.394076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.394629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.394901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.395165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.395788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:34.396081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.397813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.409510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1234/2421] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:44:34.413793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.424253 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e20a-9d9f-494f-be9d-d0a5862d2504 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.429012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.429392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.429703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.429967 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.430574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.432447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.475874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03303e4b069f411290ed4e5b11504cf1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.476520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03303e4b069f411290ed4e5b11504cf1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.483306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03303e4b069f411290ed4e5b11504cf1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.494916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03303e4b069f411290ed4e5b11504cf1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.495562 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fccaa272-ffe8-4e88-9577-929af1714952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03303e4b069f411290ed4e5b11504cf1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:34.555618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1235/2422] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:34 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:34.559998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.561588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:34.576058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1188/2423] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:34 2022] DELETE /identity/v3/users/03303e4b069f411290ed4e5b11504cf1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:34.580815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff614-804b-4185-8622-118139595e70 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.581120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff614-804b-4185-8622-118139595e70 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.581397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff614-804b-4185-8622-118139595e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.602110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-57cff614-804b-4185-8622-118139595e70 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:34.603318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-57cff614-804b-4185-8622-118139595e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:34.626565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab305a-2368-470c-b027-61fd912a7ec5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.663633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1189/2424] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:34.674561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff614-804b-4185-8622-118139595e70 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.675921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-57cff614-804b-4185-8622-118139595e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:34.676695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:34.685123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.685752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.686034 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.686352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.687273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.689199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.730302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:34.734620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff614-804b-4185-8622-118139595e70 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.738246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.738897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.739182 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.739470 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.748184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.750191 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.759417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1190/2425] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:34.796997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1236/2426] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:34 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:34.804415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.813214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3310d2-192f-4866-8591-82dc07163a0a service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.818034 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.818637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.818920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.819196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.819833 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.821493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.833056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1191/2427] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:34.836334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.847414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42456f7-db2d-4398-8d9a-c9a6042b0362 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.852452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.853160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.856046 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.856046 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.856046 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.856429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.867417 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1237/2428] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:44:34.871577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.882889 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf9b73-2157-4ae0-9176-dc1d2126f251 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.887933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f1eed-dc3a-4091-be30-005d5cbf1c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.888662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f1eed-dc3a-4091-be30-005d5cbf1c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.889018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f1eed-dc3a-4091-be30-005d5cbf1c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.889425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f1eed-dc3a-4091-be30-005d5cbf1c5e admin admin] PATH_INFO: `/v3/projects/6c7020ad863d4e23a7f45a668425a23c/users/6509e94ed42f45769cbce0927febe17b/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.901482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:34.903259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:34.906714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f1eed-dc3a-4091-be30-005d5cbf1c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7020ad863d4e23a7f45a668425a23c, user_id=6509e94ed42f45769cbce0927febe17b, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.909415 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f1eed-dc3a-4091-be30-005d5cbf1c5e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.916844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5f8d-a5e3-44cf-a5f2-97f34fbed2d0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:34.922420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:34.923039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:34.923318 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:34.923591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] PATH_INFO: `/v3/users/47680d7bd2444c5bb220a68245891318` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:34.924706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47680d7bd2444c5bb220a68245891318)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:34.926634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:34.986262 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1192/2429] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:34 2022] PUT /identity/v3/projects/6c7020ad863d4e23a7f45a668425a23c/users/6509e94ed42f45769cbce0927febe17b/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:35.003493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad43b9-1055-4ffe-9513-0c810a708514 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.003784 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad43b9-1055-4ffe-9513-0c810a708514 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.004065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad43b9-1055-4ffe-9513-0c810a708514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.035378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-eaad43b9-1055-4ffe-9513-0c810a708514 None None] MFA Rules not processed for user `6509e94ed42f45769cbce0927febe17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:35.036979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-eaad43b9-1055-4ffe-9513-0c810a708514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.103863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1193/2430] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:35.108376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad43b9-1055-4ffe-9513-0c810a708514 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.130692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47680d7bd2444c5bb220a68245891318'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.138676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47680d7bd2444c5bb220a68245891318'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.173734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad43b9-1055-4ffe-9513-0c810a708514 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.178323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7325d76-1c32-4e86-ab7c-5493db1ee8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.178931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325d76-1c32-4e86-ab7c-5493db1ee8ba admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.179214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325d76-1c32-4e86-ab7c-5493db1ee8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.179491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325d76-1c32-4e86-ab7c-5493db1ee8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.180116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7325d76-1c32-4e86-ab7c-5493db1ee8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.182090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7325d76-1c32-4e86-ab7c-5493db1ee8ba admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.242446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47680d7bd2444c5bb220a68245891318'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.255618 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47680d7bd2444c5bb220a68245891318'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.256264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47680d7bd2444c5bb220a68245891318'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.262069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1238/2431] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:34 2022] DELETE /identity/v3/users/47680d7bd2444c5bb220a68245891318 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:35.265150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.265150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.326064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1194/2432] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:35 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:35.329117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a9053-4433-41b2-ab8b-81be012107f3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.331058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.331544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.331658 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.352153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:35.353403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.381973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:35.383705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:35.392922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.393596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.393875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.394146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] PATH_INFO: `/v3/projects/46a3ae957974441bb8e670e0b1179867` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.395416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a3ae957974441bb8e670e0b1179867)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.397484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.418204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1195/2433] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:35.419021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.421257 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.437215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddcde-9265-4bcc-91c2-dedbb63b4638 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.438999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.439598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.439876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.440144 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.440765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.442712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.498296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a3ae957974441bb8e670e0b1179867', 'request_id': 'req-4b73483d-6222-4474-80d6-69edf95cedaf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.503913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a3ae957974441bb8e670e0b1179867', 'request_id': 'req-4b73483d-6222-4474-80d6-69edf95cedaf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.510229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a3ae957974441bb8e670e0b1179867', 'request_id': 'req-4b73483d-6222-4474-80d6-69edf95cedaf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.562417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1196/2434] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:35 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:35.563442 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.565124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.589780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] The token cache is being invalidate because project 46a3ae957974441bb8e670e0b1179867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:35.590073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.590836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.592369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1239/2435] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:35 2022] DELETE /identity/v3/projects/46a3ae957974441bb8e670e0b1179867 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:35.593293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.595003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.624145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47cc58-7925-47fa-af49-cc711fa3c3b8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.658353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73483d-6222-4474-80d6-69edf95cedaf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.663635 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.664449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.665225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.665551 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.666203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.667784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.674066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.679170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.679170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.679170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.679170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.679550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1240/2436] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:35.679550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.682802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.692593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.694082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.696216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614332ce-d0f3-4955-9651-1f8d5621ff4b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.700971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.701609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.702467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.702996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] PATH_INFO: `/v3/users/d2388884aa1f4d4686d8c74eb1c65174` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.704200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2388884aa1f4d4686d8c74eb1c65174)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.704538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1197/2437] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:35.705376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.706198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.715238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe08c89-d936-47ae-a48a-919181ddcc1b service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.721591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.722264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.722543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.723595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.724250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.725880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.739146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1198/2438] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:35.743488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.754756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb98410-aff6-4005-8d66-50d360f160aa admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:35.759394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71780c2c-4be8-47d1-945c-62ba522026a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:35.760052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780c2c-4be8-47d1-945c-62ba522026a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.760337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780c2c-4be8-47d1-945c-62ba522026a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.760614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780c2c-4be8-47d1-945c-62ba522026a8 admin admin] PATH_INFO: `/v3/projects/e9a99ac6c51a47d697b93aec0f33df40/users/87a1a2e9b3a747d3b832a675c05c1d0b/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.782213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71780c2c-4be8-47d1-945c-62ba522026a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a99ac6c51a47d697b93aec0f33df40, user_id=87a1a2e9b3a747d3b832a675c05c1d0b, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:35.784926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71780c2c-4be8-47d1-945c-62ba522026a8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:35.864852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1199/2439] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:35 2022] PUT /identity/v3/projects/e9a99ac6c51a47d697b93aec0f33df40/users/87a1a2e9b3a747d3b832a675c05c1d0b/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:35.876637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d69b1-ef9b-40e0-bfd9-0d0dd9714abf None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:35.876923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d69b1-ef9b-40e0-bfd9-0d0dd9714abf None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:35.877238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d69b1-ef9b-40e0-bfd9-0d0dd9714abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:35.903510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2388884aa1f4d4686d8c74eb1c65174'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.909342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-590d69b1-ef9b-40e0-bfd9-0d0dd9714abf None None] MFA Rules not processed for user `87a1a2e9b3a747d3b832a675c05c1d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:35.910520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-590d69b1-ef9b-40e0-bfd9-0d0dd9714abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:35.913326 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2388884aa1f4d4686d8c74eb1c65174'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.943799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:35.970225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2388884aa1f4d4686d8c74eb1c65174'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.979470 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:35.984354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1200/2440] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:35.986493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2388884aa1f4d4686d8c74eb1c65174'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.987212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2388884aa1f4d4686d8c74eb1c65174'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:35.988458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d69b1-ef9b-40e0-bfd9-0d0dd9714abf None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:35.993851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1241/2441] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:35 2022] DELETE /identity/v3/users/d2388884aa1f4d4686d8c74eb1c65174 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:36.063968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d69b1-ef9b-40e0-bfd9-0d0dd9714abf None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.123170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.123816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.124088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.124365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.125007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.129281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.130778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.132401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.151380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6e44c-0147-4220-b66c-5a2b16673b11 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.158168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.159340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.159733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.160159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] PATH_INFO: `/v3/projects/3d54581bd7b54769af94ca911e9606d8` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.162061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d54581bd7b54769af94ca911e9606d8)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.164297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.243105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1201/2442] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:35 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:36.246620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.248158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.279251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d54581bd7b54769af94ca911e9606d8', 'request_id': 'req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.287007 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d54581bd7b54769af94ca911e9606d8', 'request_id': 'req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.293295 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d54581bd7b54769af94ca911e9606d8', 'request_id': 'req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.340873 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72056f6-e155-4deb-862c-36a2b4fc214e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.345340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:36.361945 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] The token cache is being invalidate because project 3d54581bd7b54769af94ca911e9606d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:36.362238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.363048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-586df438-d6cc-4a7f-adcc-c2ea1c547a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.364692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1242/2443] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:36 2022] DELETE /identity/v3/projects/3d54581bd7b54769af94ca911e9606d8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:36.369458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050955b-9163-41a8-9e2e-3c4c61289276 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.369741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050955b-9163-41a8-9e2e-3c4c61289276 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.370014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050955b-9163-41a8-9e2e-3c4c61289276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.392717 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9050955b-9163-41a8-9e2e-3c4c61289276 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:36.394090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9050955b-9163-41a8-9e2e-3c4c61289276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.409964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.410623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.411273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.411273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.411925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.414313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.458854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1243/2444] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:36.466536 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a095d-7091-45c3-a2b6-164a2eaad70f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.466820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a095d-7091-45c3-a2b6-164a2eaad70f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.467091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a095d-7091-45c3-a2b6-164a2eaad70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.486356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-882a095d-7091-45c3-a2b6-164a2eaad70f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:36.487537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-882a095d-7091-45c3-a2b6-164a2eaad70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.498532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1244/2445] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:36.501729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a095d-7091-45c3-a2b6-164a2eaad70f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.510658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a095d-7091-45c3-a2b6-164a2eaad70f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.515890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.516449 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.516720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.516984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.517731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:36.518029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.519628 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.526313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1202/2446] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:36 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:36.527230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.528898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.535334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1245/2447] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:44:36.539063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.539271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.546772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2e7c2-d362-4831-9b7c-af1aa89ef0cb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.551668 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.552522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.552876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.553336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] PATH_INFO: `/v3/projects/e4fe7824104f46b4a48cee4259658e35` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.554593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fe7824104f46b4a48cee4259658e35)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.556597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.557358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b1861-bef6-44a4-a313-586fac760e15 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.570300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.570300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.570300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.570300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.570680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.570680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.579012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1246/2448] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:36.579863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.589692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cae0bb-4a7f-425a-8a70-b7deb3ee4024 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.594193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.596674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.596674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.596674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.596674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.597843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.686895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1247/2449] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:36 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:36.687733 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.696802 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fe7824104f46b4a48cee4259658e35', 'request_id': 'req-f38b7006-2345-419c-a568-a5e21ac30974'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.710746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:36.751413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a619cc-681a-4283-a4f0-20a2ed982391 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.756212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.756865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.757266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.757573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] PATH_INFO: `/v3/projects/67254c3d4f1a4700b934e17a243845c0/users/02988c1650984ec7be99398bfde1b0f4/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.771067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67254c3d4f1a4700b934e17a243845c0, user_id=02988c1650984ec7be99398bfde1b0f4, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.773421 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fe7824104f46b4a48cee4259658e35', 'request_id': 'req-f38b7006-2345-419c-a568-a5e21ac30974'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.773882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.779651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fe7824104f46b4a48cee4259658e35', 'request_id': 'req-f38b7006-2345-419c-a568-a5e21ac30974'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.792626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] The token cache is being invalidate because project e4fe7824104f46b4a48cee4259658e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:36.792915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.793597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:36.795351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1203/2450] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:36 2022] DELETE /identity/v3/projects/e4fe7824104f46b4a48cee4259658e35 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:36.798762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.798762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.853768 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1248/2451] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:36 2022] PUT /identity/v3/projects/67254c3d4f1a4700b934e17a243845c0/users/02988c1650984ec7be99398bfde1b0f4/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:36.854659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:36.857810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:36.867069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b7006-2345-419c-a568-a5e21ac30974 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.891447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:36.923473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.924100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.924376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.924576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebee96-de87-4417-b4b1-3cd1a6f49483 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:36.925023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.925286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.927186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:36.929453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:36.930244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:36.930558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:36.930832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] PATH_INFO: `/v3/users/527e69a201914d6098bda2e3be044e9e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:36.931962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527e69a201914d6098bda2e3be044e9e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:36.933926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.044989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1204/2452] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:36 2022] POST /identity/v3/users => generated 303 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:37.046509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.048126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.059503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4a93f-3cfb-4c53-b7f3-22aa154b1b9c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.064844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.065544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.065821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.066094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.066728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.068343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.079310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1205/2453] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:37.080413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.090393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fbf4b-9620-472d-a113-0ff510b88427 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.095774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.096355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.096636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.096987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.097653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.099240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.111360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1206/2454] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:37.112093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.121754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d1299-686e-4528-ae69-792c66fde4ef admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.126593 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.127240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.127543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.127813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] PATH_INFO: `/v3/projects/67254c3d4f1a4700b934e17a243845c0/users/02988c1650984ec7be99398bfde1b0f4/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.130851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67254c3d4f1a4700b934e17a243845c0, user_id=02988c1650984ec7be99398bfde1b0f4, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.132344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.142667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1207/2455] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:37 2022] PUT /identity/v3/projects/67254c3d4f1a4700b934e17a243845c0/users/02988c1650984ec7be99398bfde1b0f4/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:37.143416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.166902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527e69a201914d6098bda2e3be044e9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:37.184272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527e69a201914d6098bda2e3be044e9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:37.212377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74606701-eea3-4701-a443-cbc160dda52f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.217078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0c81-edb8-43b8-aafb-9c6da6ef8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.218177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0c81-edb8-43b8-aafb-9c6da6ef8d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.218459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0c81-edb8-43b8-aafb-9c6da6ef8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.218726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0c81-edb8-43b8-aafb-9c6da6ef8d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.219360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e0c81-edb8-43b8-aafb-9c6da6ef8d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.220954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e0c81-edb8-43b8-aafb-9c6da6ef8d69 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.230676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1208/2456] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:37.231842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.232126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.232397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.253693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527e69a201914d6098bda2e3be044e9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:37.259846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] MFA Rules not processed for user `02988c1650984ec7be99398bfde1b0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:37.261062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.266650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527e69a201914d6098bda2e3be044e9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:37.267313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527e69a201914d6098bda2e3be044e9e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:37.273317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1249/2457] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:36 2022] DELETE /identity/v3/users/527e69a201914d6098bda2e3be044e9e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:37.274314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.275958 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.339968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1209/2458] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:37.349934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec1aa8-3270-4f18-95cd-79ee4061a1d7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.351680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.353088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.355139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc691e-10a6-48ef-bb4f-6dd7089721b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.356497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc691e-10a6-48ef-bb4f-6dd7089721b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.356497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc691e-10a6-48ef-bb4f-6dd7089721b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.356497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc691e-10a6-48ef-bb4f-6dd7089721b4 admin admin] PATH_INFO: `/v3/projects/9903e4169b6c4c559a7cf4d79072e949/users/a6afd4eeb72b44e3bb7fa7eee64a63ad/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.375245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc691e-10a6-48ef-bb4f-6dd7089721b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9903e4169b6c4c559a7cf4d79072e949, user_id=a6afd4eeb72b44e3bb7fa7eee64a63ad, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.377937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc691e-10a6-48ef-bb4f-6dd7089721b4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.410299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d66fce-1ec5-4364-a4fe-6d799717a59f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.422629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:37.459695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:37.460595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1250/2459] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:37 2022] PUT /identity/v3/projects/9903e4169b6c4c559a7cf4d79072e949/users/a6afd4eeb72b44e3bb7fa7eee64a63ad/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:37.464214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.464214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.464214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.464214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.465413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.465691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.466008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.486208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:37.487791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.537359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.538868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.550495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1210/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:37.561077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1251/2461] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:37.569989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.574121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.633881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f7c6f-243f-4e71-8867-65cb25922c67 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.683069 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.683677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.683952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.684227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.685195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.686737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.694250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.695957 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.707082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1211/2462] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:37.707747 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:37.709042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.732408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9cc31-7bb5-4664-ad23-6135c65b4799 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.739627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.740273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.740637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.740809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] PATH_INFO: `/v3/projects/0f600a6aa40b4a68a3b0ffe524885f95` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.742355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f600a6aa40b4a68a3b0ffe524885f95)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.744349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.748539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:37.768487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6e89-e9cb-4849-a914-13a3a8beddf7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:37.773824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd043ec-746f-42f9-8a49-5f8d1c53680f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:37.774424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd043ec-746f-42f9-8a49-5f8d1c53680f service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:37.774696 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd043ec-746f-42f9-8a49-5f8d1c53680f service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:37.774962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd043ec-746f-42f9-8a49-5f8d1c53680f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:37.776677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5fd043ec-746f-42f9-8a49-5f8d1c53680f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:37.835973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd043ec-746f-42f9-8a49-5f8d1c53680f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:37.837490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd043ec-746f-42f9-8a49-5f8d1c53680f service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:37.847321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1252/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:37.882723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:37.904157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f600a6aa40b4a68a3b0ffe524885f95', 'request_id': 'req-a61c80ca-3551-4556-885a-7c2a34c8fe39'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:38.002439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f600a6aa40b4a68a3b0ffe524885f95', 'request_id': 'req-a61c80ca-3551-4556-885a-7c2a34c8fe39'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:38.009724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f600a6aa40b4a68a3b0ffe524885f95', 'request_id': 'req-a61c80ca-3551-4556-885a-7c2a34c8fe39'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:38.022691 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] The token cache is being invalidate because project 0f600a6aa40b4a68a3b0ffe524885f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:38.022905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:38.023618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a61c80ca-3551-4556-885a-7c2a34c8fe39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:38.028795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1212/2464] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:37 2022] DELETE /identity/v3/projects/0f600a6aa40b4a68a3b0ffe524885f95 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:38.030307 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeb167-b3e4-4c14-aa39-93c2aec22d7b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.030754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeb167-b3e4-4c14-aa39-93c2aec22d7b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.031023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeb167-b3e4-4c14-aa39-93c2aec22d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.072226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2feeb167-b3e4-4c14-aa39-93c2aec22d7b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:38.073488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2feeb167-b3e4-4c14-aa39-93c2aec22d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:38.154970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1253/2465] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:38.162811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a55b5-2487-4659-be05-d90a8ad6fbca None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.163519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a55b5-2487-4659-be05-d90a8ad6fbca None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.163967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a55b5-2487-4659-be05-d90a8ad6fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.196259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-503a55b5-2487-4659-be05-d90a8ad6fbca None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:38.197640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-503a55b5-2487-4659-be05-d90a8ad6fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:38.205730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1213/2466] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:38.210362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeb167-b3e4-4c14-aa39-93c2aec22d7b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:38.220692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeb167-b3e4-4c14-aa39-93c2aec22d7b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:38.225267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:38.225858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.226151 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.226418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.227051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:38.227373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:38.228976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:38.241424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1254/2467] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:38.245880 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a55b5-2487-4659-be05-d90a8ad6fbca None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:38.255429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a55b5-2487-4659-be05-d90a8ad6fbca None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:38.260030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:38.260631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.260878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.261185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.261811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:38.263829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:38.341695 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1214/2468] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:38 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:38.351089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:38.362484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5acd9-9dc6-4dfb-a879-2f8b2d9726a2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:38.426691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:38.427431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.427810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.428147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.429650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:38.431880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:38.606504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1255/2469] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:38 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:38.610652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:38.622037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d588bb-7f32-43c8-a1c4-4ea8bca52e18 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:38.628847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:38.629971 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.630259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.630603 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.631692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:38.633995 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:38.649750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1215/2470] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:38.651057 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:38.662934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335366-f727-4930-9fe5-0a522f6104fa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:38.667928 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fdf68-6903-43c2-99ae-f7f202c67a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:38.668542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fdf68-6903-43c2-99ae-f7f202c67a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.668855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fdf68-6903-43c2-99ae-f7f202c67a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.669407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fdf68-6903-43c2-99ae-f7f202c67a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.670336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fdf68-6903-43c2-99ae-f7f202c67a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:38.672758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fdf68-6903-43c2-99ae-f7f202c67a83 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:38.684120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1256/2471] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:38.689066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:38.700559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeb4b2-8b97-4ba3-92ec-076bc274c56a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:38.705782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:38.706450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.706848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.707128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] PATH_INFO: `/v3/projects/0cceda148d9b4ddb9f0b63148097cfdf/users/7bbe53e23d7e464693ebee3328630678/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.723578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cceda148d9b4ddb9f0b63148097cfdf, user_id=7bbe53e23d7e464693ebee3328630678, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:38.726507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:38.833357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1216/2472] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:38 2022] PUT /identity/v3/projects/0cceda148d9b4ddb9f0b63148097cfdf/users/7bbe53e23d7e464693ebee3328630678/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:38.834423 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6248-eb38-4bf3-bca5-dba9f57ddcfd None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:38.834897 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6248-eb38-4bf3-bca5-dba9f57ddcfd None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:38.836863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6248-eb38-4bf3-bca5-dba9f57ddcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:38.897344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-d1fe6248-eb38-4bf3-bca5-dba9f57ddcfd None None] MFA Rules not processed for user `7bbe53e23d7e464693ebee3328630678`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:38.898579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d1fe6248-eb38-4bf3-bca5-dba9f57ddcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:38.964133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:38.974198 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1257/2473] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:38.986044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:38.987730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:39.049872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:39.054394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e303e6b-06e7-4019-a7fd-0c2d28c1718a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:39.058506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:39.059672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.059672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.059890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.069382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:39.071027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:39.082095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1217/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:39.145986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608aab3-207f-4335-b5b8-d58135794c90 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.146510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608aab3-207f-4335-b5b8-d58135794c90 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.146609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608aab3-207f-4335-b5b8-d58135794c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.182596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3608aab3-207f-4335-b5b8-d58135794c90 None None] MFA Rules not processed for user `a6afd4eeb72b44e3bb7fa7eee64a63ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:39.183769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3608aab3-207f-4335-b5b8-d58135794c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:39.258002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1258/2475] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:39 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:39.267397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:39.268900 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:39.338434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f8ec-0fd5-4a08-be9a-c2117f23d4ed service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:39.343500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:39.344160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.344440 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.344711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.345390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:39.347322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:39.451612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1218/2476] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:39 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:39.456539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608aab3-207f-4335-b5b8-d58135794c90 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:39.467579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608aab3-207f-4335-b5b8-d58135794c90 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:39.524684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:39.525312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.525588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.525859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.526485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:39.528490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:39.613230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1259/2477] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:39 2022] POST /identity/v3/users => generated 309 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:39.617482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:39.629186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de7e5-3d7f-4a25-a8ee-c669a03a3376 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:39.633866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:39.634446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.634744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.635015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.635648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:39.637261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:39.648493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1219/2478] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:39.652667 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:39.662728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211110fe-033e-4e76-adbc-77187d30bd65 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:39.667282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:39.667927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.668208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.668482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] PATH_INFO: `/v3/projects/8512c2fcd5e24b18ac2a69fca32f4d76/users/3e5c479932024642bf2300ee5d1c9c48/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.683609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8512c2fcd5e24b18ac2a69fca32f4d76, user_id=3e5c479932024642bf2300ee5d1c9c48, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:39.687055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:39.750737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1260/2479] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:39 2022] PUT /identity/v3/projects/8512c2fcd5e24b18ac2a69fca32f4d76/users/3e5c479932024642bf2300ee5d1c9c48/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:39.755041 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:39.764786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31a9f6-3750-432a-a121-9e0620f3a5c7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:39.825010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71fc96-be42-4441-9512-89e6c8dde568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:39.825642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71fc96-be42-4441-9512-89e6c8dde568 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.825921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71fc96-be42-4441-9512-89e6c8dde568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.826193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71fc96-be42-4441-9512-89e6c8dde568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.826876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71fc96-be42-4441-9512-89e6c8dde568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:39.828722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71fc96-be42-4441-9512-89e6c8dde568 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:39.838580 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1220/2480] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:39.843289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:39.854487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569637b-7a59-4859-b2a8-37f56f4277be admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:39.860354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:39.861111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:39.861395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:39.861669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] PATH_INFO: `/v3/projects/8512c2fcd5e24b18ac2a69fca32f4d76/users/3e5c479932024642bf2300ee5d1c9c48/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:39.863620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8512c2fcd5e24b18ac2a69fca32f4d76, user_id=3e5c479932024642bf2300ee5d1c9c48, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:39.866328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:39.878245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1261/2481] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:39 2022] PUT /identity/v3/projects/8512c2fcd5e24b18ac2a69fca32f4d76/users/3e5c479932024642bf2300ee5d1c9c48/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:41.818938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:41.819407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:41.819534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:41.880382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] MFA Rules not processed for user `3e5c479932024642bf2300ee5d1c9c48`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:41.882289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:41.933407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:41.955913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1221/2482] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:41 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:42.301008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:42.302918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:42.375003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:42.402758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e574-248f-4470-8394-b982a9d249fc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:42.408453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:42.409721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:42.410210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:42.410713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] PATH_INFO: `/v3/users/6509e94ed42f45769cbce0927febe17b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:42.412766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6509e94ed42f45769cbce0927febe17b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:42.415169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:42.553630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:42.555362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:42.634199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028413e2-cda6-4af6-8898-57ef514c7364 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:42.639241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f1aee-99dc-4bc7-851c-4105b3aa20f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:42.641256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1aee-99dc-4bc7-851c-4105b3aa20f9 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:42.641542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1aee-99dc-4bc7-851c-4105b3aa20f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:42.642423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1aee-99dc-4bc7-851c-4105b3aa20f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:42.646347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a74f1aee-99dc-4bc7-851c-4105b3aa20f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:42.655652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6509e94ed42f45769cbce0927febe17b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:42.659256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f1aee-99dc-4bc7-851c-4105b3aa20f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:42.661074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f1aee-99dc-4bc7-851c-4105b3aa20f9 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:42.663065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6509e94ed42f45769cbce0927febe17b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:42.674503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1222/2483] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:42.793865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6509e94ed42f45769cbce0927febe17b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:42.812949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6509e94ed42f45769cbce0927febe17b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:42.817085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6509e94ed42f45769cbce0927febe17b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:42.823690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1262/2484] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:42 2022] DELETE /identity/v3/users/6509e94ed42f45769cbce0927febe17b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:42.828862 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:42.829355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:42.829631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:42.852976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:42.854288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:42.923135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1223/2485] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:42.932757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:42.934187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:42.992930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c974-b05c-4168-af76-f857a042636f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:42.996863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:42.997898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:42.997898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:42.998225 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:43.008381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:43.009996 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:43.022864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1263/2486] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:43.433290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:43.434877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:43.454993 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58aaa-f63e-41f3-b9c6-52a30104ddf8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:43.465639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:43.466305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:43.466588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:43.466868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] PATH_INFO: `/v3/users/a6afd4eeb72b44e3bb7fa7eee64a63ad` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:43.468631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6afd4eeb72b44e3bb7fa7eee64a63ad)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:43.470789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:43.509259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:43.510697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:43.526707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90fe87-fcac-45bf-b1cf-10352532ceff service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:43.532328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:43.532969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:43.533285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:43.534137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] PATH_INFO: `/v3/projects/6c7020ad863d4e23a7f45a668425a23c` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:43.534975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7020ad863d4e23a7f45a668425a23c)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:43.537135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:43.709056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7020ad863d4e23a7f45a668425a23c', 'request_id': 'req-05a25992-f460-48a2-9a13-943c6c819427'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.709743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6afd4eeb72b44e3bb7fa7eee64a63ad'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.710484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6afd4eeb72b44e3bb7fa7eee64a63ad'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.713513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:43.719856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7020ad863d4e23a7f45a668425a23c', 'request_id': 'req-05a25992-f460-48a2-9a13-943c6c819427'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.720047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6afd4eeb72b44e3bb7fa7eee64a63ad'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.724586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7020ad863d4e23a7f45a668425a23c', 'request_id': 'req-05a25992-f460-48a2-9a13-943c6c819427'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.731432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:43.733728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6afd4eeb72b44e3bb7fa7eee64a63ad'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.734379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6afd4eeb72b44e3bb7fa7eee64a63ad'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.793239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] The token cache is being invalidate because project 6c7020ad863d4e23a7f45a668425a23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:43.793581 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.794239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:43.797817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1264/2487] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:43 2022] DELETE /identity/v3/projects/6c7020ad863d4e23a7f45a668425a23c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:43.800556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:43.802232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:43.856389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1224/2488] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:43 2022] DELETE /identity/v3/users/a6afd4eeb72b44e3bb7fa7eee64a63ad => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:43.891385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a25992-f460-48a2-9a13-943c6c819427 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:43.956771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:43.957643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:43.957963 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:43.958172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] PATH_INFO: `/v3/users/87a1a2e9b3a747d3b832a675c05c1d0b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:43.959405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a1a2e9b3a747d3b832a675c05c1d0b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:43.961441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:44.127537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:44.129071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:44.144477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9578c2e-0ec0-4ded-b543-82af510d6d21 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:44.152481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:44.153531 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:44.165148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:44.165429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] PATH_INFO: `/v3/projects/9903e4169b6c4c559a7cf4d79072e949` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:44.166472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a1a2e9b3a747d3b832a675c05c1d0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.171788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9903e4169b6c4c559a7cf4d79072e949)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:44.173973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:44.176964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a1a2e9b3a747d3b832a675c05c1d0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.301972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a1a2e9b3a747d3b832a675c05c1d0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.314866 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a1a2e9b3a747d3b832a675c05c1d0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.315499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a1a2e9b3a747d3b832a675c05c1d0b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.321371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1265/2489] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:43 2022] DELETE /identity/v3/users/87a1a2e9b3a747d3b832a675c05c1d0b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:44.352538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9903e4169b6c4c559a7cf4d79072e949', 'request_id': 'req-2cccf238-68e8-4224-aed1-766c955fc144'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.449601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9903e4169b6c4c559a7cf4d79072e949', 'request_id': 'req-2cccf238-68e8-4224-aed1-766c955fc144'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.458368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9903e4169b6c4c559a7cf4d79072e949', 'request_id': 'req-2cccf238-68e8-4224-aed1-766c955fc144'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.472131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] The token cache is being invalidate because project 9903e4169b6c4c559a7cf4d79072e949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:44.472357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.472987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.474670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1225/2490] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:44 2022] DELETE /identity/v3/projects/9903e4169b6c4c559a7cf4d79072e949 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:44.479386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:44.481018 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:44.558823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bab74-7ce0-42d6-9659-72b1f25d21bd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:44.630047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:44.630686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:44.630964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:44.631236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] PATH_INFO: `/v3/users/3e5c479932024642bf2300ee5d1c9c48` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:44.632374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5c479932024642bf2300ee5d1c9c48)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:44.634331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:44.799562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:44.804875 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:44.806270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:44.818820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5c479932024642bf2300ee5d1c9c48'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.825284 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf238-68e8-4224-aed1-766c955fc144 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:44.828669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5c479932024642bf2300ee5d1c9c48'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.831327 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:44.831968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:44.832286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:44.833140 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] PATH_INFO: `/v3/projects/e9a99ac6c51a47d697b93aec0f33df40` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:44.834500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a99ac6c51a47d697b93aec0f33df40)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:44.836400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:44.936648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5c479932024642bf2300ee5d1c9c48'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.952804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5c479932024642bf2300ee5d1c9c48'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.962831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5c479932024642bf2300ee5d1c9c48'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.962982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a99ac6c51a47d697b93aec0f33df40', 'request_id': 'req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:44.963426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1266/2491] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:44 2022] DELETE /identity/v3/users/3e5c479932024642bf2300ee5d1c9c48 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:45.067624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a99ac6c51a47d697b93aec0f33df40', 'request_id': 'req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.074463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a99ac6c51a47d697b93aec0f33df40', 'request_id': 'req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.089523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] The token cache is being invalidate because project e9a99ac6c51a47d697b93aec0f33df40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:45.089963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.090637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.092148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1226/2492] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:44 2022] DELETE /identity/v3/projects/e9a99ac6c51a47d697b93aec0f33df40 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:45.097673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:45.100120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:45.189355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb688c8-6c2d-4904-9c7c-e51613ab3600 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:45.194540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:45.195208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.195489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.195764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] PATH_INFO: `/v3/users/02988c1650984ec7be99398bfde1b0f4` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.196882 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=02988c1650984ec7be99398bfde1b0f4)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:45.198961 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:45.286952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:45.288366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:45.344361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:45.356568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1078-3f6a-476d-9ad2-b3a917d052ab admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:45.361760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:45.362424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.362705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.363059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] PATH_INFO: `/v3/projects/8512c2fcd5e24b18ac2a69fca32f4d76` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.364173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8512c2fcd5e24b18ac2a69fca32f4d76)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:45.366172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:45.412508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02988c1650984ec7be99398bfde1b0f4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.419493 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02988c1650984ec7be99398bfde1b0f4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.493280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8512c2fcd5e24b18ac2a69fca32f4d76', 'request_id': 'req-8157b08c-fadd-41b2-8732-c8508eeb58f6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.507579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02988c1650984ec7be99398bfde1b0f4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.520419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02988c1650984ec7be99398bfde1b0f4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.521083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02988c1650984ec7be99398bfde1b0f4'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.526825 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1267/2493] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:45 2022] DELETE /identity/v3/users/02988c1650984ec7be99398bfde1b0f4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:45.552234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:45.554024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:45.618500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db26a-cfb3-494f-9139-203d61bb3fdd admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:45.622975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:45.623601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.624521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.624880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] PATH_INFO: `/v3/users/7bbe53e23d7e464693ebee3328630678` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.625115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8512c2fcd5e24b18ac2a69fca32f4d76', 'request_id': 'req-8157b08c-fadd-41b2-8732-c8508eeb58f6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.626049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbe53e23d7e464693ebee3328630678)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:45.627942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:45.631541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8512c2fcd5e24b18ac2a69fca32f4d76', 'request_id': 'req-8157b08c-fadd-41b2-8732-c8508eeb58f6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.644527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] The token cache is being invalidate because project 8512c2fcd5e24b18ac2a69fca32f4d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:45.644816 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.645509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-8157b08c-fadd-41b2-8732-c8508eeb58f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.648854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1227/2494] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:45 2022] DELETE /identity/v3/projects/8512c2fcd5e24b18ac2a69fca32f4d76 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:45.651703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bfa5b-ce28-46c0-a177-f6d4fba9a40b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.652055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bfa5b-ce28-46c0-a177-f6d4fba9a40b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.652425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bfa5b-ce28-46c0-a177-f6d4fba9a40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.672467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ea5bfa5b-ce28-46c0-a177-f6d4fba9a40b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:45.677793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ea5bfa5b-ce28-46c0-a177-f6d4fba9a40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:45.681501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1228/2495] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:45.690003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681c97-5b86-4d37-8557-dd49c2b2efb7 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.690420 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681c97-5b86-4d37-8557-dd49c2b2efb7 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.690815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681c97-5b86-4d37-8557-dd49c2b2efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.715199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-af681c97-5b86-4d37-8557-dd49c2b2efb7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:45.723160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-af681c97-5b86-4d37-8557-dd49c2b2efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:45.737405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1229/2496] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:45.740978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681c97-5b86-4d37-8557-dd49c2b2efb7 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:45.756397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:45.764532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681c97-5b86-4d37-8557-dd49c2b2efb7 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:45.767738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:45.768581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.769147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.769659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.770719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:45.771403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:45.773989 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:45.795492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1230/2497] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:45.800193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:45.810994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a33fa7-98fd-4d3e-9167-5b75070889ae admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:45.817721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:45.819194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.819194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.819194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.819570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:45.822081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:45.831176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbe53e23d7e464693ebee3328630678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.841564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbe53e23d7e464693ebee3328630678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.914990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1231/2498] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:45 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:45.916325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:45.978682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dd64f-a169-4ec3-a7c3-6faae400ae15 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:45.981741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbe53e23d7e464693ebee3328630678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.984353 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:45.984963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:45.985278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:45.985547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:45.986176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:45.988185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:45.995626 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbe53e23d7e464693ebee3328630678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:45.996327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-81d02002-8fc7-4283-a62d-18d848350bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbe53e23d7e464693ebee3328630678'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:46.002990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1268/2499] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:45 2022] DELETE /identity/v3/users/7bbe53e23d7e464693ebee3328630678 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:46.007402 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.007692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.007975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.027266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:46.028505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.068763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1232/2500] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:45 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:46.068763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.068763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.081505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533506c-bb2e-4a56-bef2-ed995455f2c6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.102008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1269/2501] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:46.105802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.105802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.117468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c1ed2-97ea-4e4c-9989-1f5ed0f7b933 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.122617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.123233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.123546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.123988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.124794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.126422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.143617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1270/2502] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:46.143617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.143617 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.152847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.153731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.154394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.154394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] PATH_INFO: `/v3/projects/67254c3d4f1a4700b934e17a243845c0` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.156803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67254c3d4f1a4700b934e17a243845c0)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.161631 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.205363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cd3e9-75e2-4af1-bd9d-d61367002d32 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.209113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.209721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.210003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.210275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.214591 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:46.220545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.222033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.231554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1271/2503] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:46.232484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.242430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffd89e-e637-495e-a736-083d3c5ff226 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.246980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.247688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.247998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.248300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.248976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.251365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.263154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1272/2504] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:46.269400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.292017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6d9d-de13-4a1b-8757-fbeb3f520413 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.298236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf879d20-16cf-4230-97f9-68607b306f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.298931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf879d20-16cf-4230-97f9-68607b306f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.299215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf879d20-16cf-4230-97f9-68607b306f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.299490 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf879d20-16cf-4230-97f9-68607b306f2f admin admin] PATH_INFO: `/v3/projects/d3ba441361c1406db19951061750718f/users/65aefd768c0e4914a1848ec5303a58f8/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.321614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf879d20-16cf-4230-97f9-68607b306f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ba441361c1406db19951061750718f, user_id=65aefd768c0e4914a1848ec5303a58f8, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.324736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf879d20-16cf-4230-97f9-68607b306f2f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.337085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67254c3d4f1a4700b934e17a243845c0', 'request_id': 'req-240acdb5-f76a-466c-9970-6b27d64b0fb5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:46.382648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1273/2505] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:46 2022] PUT /identity/v3/projects/d3ba441361c1406db19951061750718f/users/65aefd768c0e4914a1848ec5303a58f8/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:46.392900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.393223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.393506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.422182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] MFA Rules not processed for user `65aefd768c0e4914a1848ec5303a58f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:46.423306 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.433548 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67254c3d4f1a4700b934e17a243845c0', 'request_id': 'req-240acdb5-f76a-466c-9970-6b27d64b0fb5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:46.440208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67254c3d4f1a4700b934e17a243845c0', 'request_id': 'req-240acdb5-f76a-466c-9970-6b27d64b0fb5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:46.453586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] The token cache is being invalidate because project 67254c3d4f1a4700b934e17a243845c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:46.453966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:46.454840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-240acdb5-f76a-466c-9970-6b27d64b0fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:46.456490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1233/2506] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:46 2022] DELETE /identity/v3/projects/67254c3d4f1a4700b934e17a243845c0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:46.462886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f883da-b13f-4b0e-87fe-3e32ac6697a4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.467567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f883da-b13f-4b0e-87fe-3e32ac6697a4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.467567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f883da-b13f-4b0e-87fe-3e32ac6697a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.490514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e4f883da-b13f-4b0e-87fe-3e32ac6697a4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:46.496131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e4f883da-b13f-4b0e-87fe-3e32ac6697a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.518704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1274/2507] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:46.522989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.524452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.548747 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:46.566011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1234/2508] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:46.575252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72bc8-ac31-43b9-b106-46937da1dcae None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.575423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72bc8-ac31-43b9-b106-46937da1dcae None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.575694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72bc8-ac31-43b9-b106-46937da1dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.598076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-6ac72bc8-ac31-43b9-b106-46937da1dcae None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:46.599596 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6ac72bc8-ac31-43b9-b106-46937da1dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.612899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1235/2509] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:46.614082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac72bc8-ac31-43b9-b106-46937da1dcae None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.625212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f301e7-195a-4d74-b164-2c8264686f65 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.628170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac72bc8-ac31-43b9-b106-46937da1dcae None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.631379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.632101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.632448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.632818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.633556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:46.633863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.635526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.637834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.638822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.639284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.639883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.640805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.643051 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.651874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1236/2510] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:46.656811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.667296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc33f-75da-4f76-b972-41f24e06d1ad admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.673492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.674043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.674326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.674598 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.675245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.677219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.744777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1275/2511] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:46.746746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.748544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:46.780313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1237/2512] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:46.780313 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.822885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77907-026a-4a02-a6a9-3c80edcc21aa admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.852777 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bb252-d237-458c-bf8a-2f874f6dfa37 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.858901 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.859707 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.859996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.860172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.860858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.862813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.890953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.891695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.891972 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.892246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] PATH_INFO: `/v3/projects/0cceda148d9b4ddb9f0b63148097cfdf` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.893443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cceda148d9b4ddb9f0b63148097cfdf)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.895702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:46.911687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:46.941151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1238/2513] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:46.941151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:46.950831 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c787d-7ace-43f8-b094-7be35c0ede0b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:46.955549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:46.956111 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:46.956389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:46.956660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:46.957316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:46.960043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.022058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cceda148d9b4ddb9f0b63148097cfdf', 'request_id': 'req-05c7f96f-870a-4111-82da-1dc7b8635d16'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:47.027477 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cceda148d9b4ddb9f0b63148097cfdf', 'request_id': 'req-05c7f96f-870a-4111-82da-1dc7b8635d16'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:47.034835 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cceda148d9b4ddb9f0b63148097cfdf', 'request_id': 'req-05c7f96f-870a-4111-82da-1dc7b8635d16'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:47.045065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1239/2514] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:46 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:47.045065 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.053794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f98d3-8a0c-474c-b015-c8e05b08f521 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.112328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.113019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.113403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.113696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.113903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] The token cache is being invalidate because project 0cceda148d9b4ddb9f0b63148097cfdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:47.114176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:47.114366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.114868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:47.116036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.129062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1276/2515] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:46 2022] DELETE /identity/v3/projects/0cceda148d9b4ddb9f0b63148097cfdf => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:47.129062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.129062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:47.129062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:47.129529 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1240/2516] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:47.134715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.136724 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:47.138791 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f96f-870a-4111-82da-1dc7b8635d16 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.144191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.144837 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.145149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.145522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.146785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.147840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.151174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2f7d-497e-4453-8670-c9af8d626eb6 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.157963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.158572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.162033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.162033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] PATH_INFO: `/v3/projects/9d3be22f3b1c43b2aea322d204b52096/users/8c84aa51d10446afaef2bb09631f0964/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.162360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1277/2517] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:47.165078 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.178067 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ae14a-1fa1-4cdc-a6b0-fb50ffb3ba5a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.183460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3be22f3b1c43b2aea322d204b52096, user_id=8c84aa51d10446afaef2bb09631f0964, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.184817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.185183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.185568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.185960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.186904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.188745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.189729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.208315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1278/2518] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:47.211720 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.227656 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2755e32-0e0f-4055-b832-72ea3e9f1fc1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.235940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.236814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.237331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.237663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] PATH_INFO: `/v3/projects/d0a6bf2480874454bca8fd22adf5d071/users/4c5c1f6be3514116b588e7ce14efa672/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.264050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a6bf2480874454bca8fd22adf5d071, user_id=4c5c1f6be3514116b588e7ce14efa672, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.267899 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.292186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1241/2519] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:47 2022] PUT /identity/v3/projects/9d3be22f3b1c43b2aea322d204b52096/users/8c84aa51d10446afaef2bb09631f0964/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:47.297535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.361980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1279/2520] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:47 2022] PUT /identity/v3/projects/d0a6bf2480874454bca8fd22adf5d071/users/4c5c1f6be3514116b588e7ce14efa672/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:47.363557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.365505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:47.392566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322ab3b-1809-47f5-94e6-c53628868b09 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.438855 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9ff85-5461-49d6-b17a-7507a971bf25 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.442602 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.443254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.443513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.443806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.445571 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:47.461400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0080-4e6a-47a6-b899-1dff58eb55c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.462010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0080-4e6a-47a6-b899-1dff58eb55c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.462286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0080-4e6a-47a6-b899-1dff58eb55c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.462571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0080-4e6a-47a6-b899-1dff58eb55c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.463204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0080-4e6a-47a6-b899-1dff58eb55c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.464786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0080-4e6a-47a6-b899-1dff58eb55c9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.479457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1242/2521] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:44:47.479457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1b8e-6d1f-4836-aed2-512b5b90d796 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.479457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1b8e-6d1f-4836-aed2-512b5b90d796 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.479457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1b8e-6d1f-4836-aed2-512b5b90d796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.487917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:47.507377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-221f1b8e-6d1f-4836-aed2-512b5b90d796 None None] MFA Rules not processed for user `4c5c1f6be3514116b588e7ce14efa672`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:47.508594 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-221f1b8e-6d1f-4836-aed2-512b5b90d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:47.510315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.511748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.522390 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1280/2522] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:47.523164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.533210 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f0b32-d099-4ee0-8ab2-9876690e6d1e service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.538525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c8613-72d9-436a-8f8d-fc5bd5ab7040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.539196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c8613-72d9-436a-8f8d-fc5bd5ab7040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.539476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c8613-72d9-436a-8f8d-fc5bd5ab7040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.540164 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c8613-72d9-436a-8f8d-fc5bd5ab7040 admin admin] PATH_INFO: `/v3/projects/9d3be22f3b1c43b2aea322d204b52096/users/8c84aa51d10446afaef2bb09631f0964/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.542140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c8613-72d9-436a-8f8d-fc5bd5ab7040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3be22f3b1c43b2aea322d204b52096, user_id=8c84aa51d10446afaef2bb09631f0964, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.545942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c8613-72d9-436a-8f8d-fc5bd5ab7040 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.557222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1281/2523] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:47 2022] PUT /identity/v3/projects/9d3be22f3b1c43b2aea322d204b52096/users/8c84aa51d10446afaef2bb09631f0964/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:47.576049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.576049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.576049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.586082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1243/2524] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:47.600717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1b8e-6d1f-4836-aed2-512b5b90d796 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.611734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] MFA Rules not processed for user `8c84aa51d10446afaef2bb09631f0964`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:47.611955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1b8e-6d1f-4836-aed2-512b5b90d796 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.613014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:47.652858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:47.675795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.676407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.676687 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.676961 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.677670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.679626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.693971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1282/2525] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:47.707847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.709342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:47.770826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:47.777826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1244/2526] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:47 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:47.779298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6ce5f-1b93-48cf-923e-ea57ec2613bf None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.783634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.806080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:47.840010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac521c8-761d-4847-b721-488223119602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.840908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac521c8-761d-4847-b721-488223119602 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.841592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac521c8-761d-4847-b721-488223119602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.842015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac521c8-761d-4847-b721-488223119602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.867063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9c79-3ea9-40fd-957a-02417140095d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.872429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.873126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.873452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.873790 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.874460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.876726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.916735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac521c8-761d-4847-b721-488223119602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.918242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac521c8-761d-4847-b721-488223119602 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.928796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1283/2527] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:47.954670 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1245/2528] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:47 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:47.958643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac521c8-761d-4847-b721-488223119602 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:47.969905 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac521c8-761d-4847-b721-488223119602 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:47.974677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:47.975313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:47.975594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:47.975872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:47.976511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:47.978458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:47.989885 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1284/2529] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:47.995791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:48.006299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1868b-8902-4182-bfb4-9faa1c5fa4ba admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:48.010968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:48.011632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:48.011932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:48.012169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] PATH_INFO: `/v3/projects/9bfdab0bb6fe434ba4f54fa06ead0f40/users/5233f36db441419c82ae08e950991781/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:48.016664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:48.038682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfdab0bb6fe434ba4f54fa06ead0f40, user_id=5233f36db441419c82ae08e950991781, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:48.041876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:48.113957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:48.125431 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e23e2-6ba3-4639-812d-841b2c954839 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:48.130537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1246/2530] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:47 2022] PUT /identity/v3/projects/9bfdab0bb6fe434ba4f54fa06ead0f40/users/5233f36db441419c82ae08e950991781/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:48.134139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:48.182658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87fbf1-4c64-4bdd-b8e0-b273b8eca406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:48.183495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87fbf1-4c64-4bdd-b8e0-b273b8eca406 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:48.183859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87fbf1-4c64-4bdd-b8e0-b273b8eca406 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:48.184192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87fbf1-4c64-4bdd-b8e0-b273b8eca406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:48.186048 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8d87fbf1-4c64-4bdd-b8e0-b273b8eca406 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:48.208538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc916d53-ebd9-45a6-8abb-61a62ad4978d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:48.213573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:48.214178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:48.214459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:48.216012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:48.216012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:48.216954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:48.230384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1247/2531] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:44:48.232076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:48.245214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75f672-f836-4936-b3f5-ea3661f23474 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:48.251225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:48.251883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:48.252162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:48.252432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] PATH_INFO: `/v3/projects/9bfdab0bb6fe434ba4f54fa06ead0f40/users/5233f36db441419c82ae08e950991781/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:48.253474 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87fbf1-4c64-4bdd-b8e0-b273b8eca406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:48.254490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfdab0bb6fe434ba4f54fa06ead0f40, user_id=5233f36db441419c82ae08e950991781, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:48.255271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87fbf1-4c64-4bdd-b8e0-b273b8eca406 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:48.257186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:48.265586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1285/2532] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:44:48.269073 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1248/2533] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:48 2022] PUT /identity/v3/projects/9bfdab0bb6fe434ba4f54fa06ead0f40/users/5233f36db441419c82ae08e950991781/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:48.279734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eac46-4be9-4a2a-a886-bc926e54a7a7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:48.280091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eac46-4be9-4a2a-a886-bc926e54a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:48.280367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eac46-4be9-4a2a-a886-bc926e54a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:48.310681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3d4eac46-4be9-4a2a-a886-bc926e54a7a7 None None] MFA Rules not processed for user `5233f36db441419c82ae08e950991781`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:48.312599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d4eac46-4be9-4a2a-a886-bc926e54a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:48.378287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:48.390119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1286/2534] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:48.402317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:48.404063 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:48.464898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b844b9-bea2-4dc7-a1b5-aef84c1f4c40 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:48.469552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:48.470357 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:48.470642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:48.470918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:48.481613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:48.483083 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:48.493765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1249/2535] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:48.734886 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eac46-4be9-4a2a-a886-bc926e54a7a7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:48.744663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eac46-4be9-4a2a-a886-bc926e54a7a7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:48.748234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:48.751031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:48.751031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:48.751031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:48.813489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:48.814922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:48.830857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1287/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:51.463391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:51.464855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:51.478049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:51.547866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f78c96-8770-4c39-8706-6c60da65ea3e service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:51.552538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:51.553230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:51.553527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:51.553795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] PATH_INFO: `/v3/users/419c0e2718cd4140b07cf0c92a18c296` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:51.554964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419c0e2718cd4140b07cf0c92a18c296)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:51.556913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:51.769581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419c0e2718cd4140b07cf0c92a18c296'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:51.770517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419c0e2718cd4140b07cf0c92a18c296'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:51.778863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419c0e2718cd4140b07cf0c92a18c296'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:51.793204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419c0e2718cd4140b07cf0c92a18c296'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:51.793891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-bdeda4e2-1239-4cbd-85c5-f0ac873fc167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419c0e2718cd4140b07cf0c92a18c296'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:51.905705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1250/2537] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:51 2022] DELETE /identity/v3/users/419c0e2718cd4140b07cf0c92a18c296 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:52.210388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:52.221989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece37e-d954-4807-8a44-5a56d32e1db9 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:52.279119 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:52.279681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:52.280645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:52.280927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] PATH_INFO: `/v3/projects/d5f72bda03e74c2286ccaadba5fff35d` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:52.282666 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f72bda03e74c2286ccaadba5fff35d)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:52.284726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:52.449485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f72bda03e74c2286ccaadba5fff35d', 'request_id': 'req-b652bc92-2da1-422b-81dc-aa92b4797a8e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:52.456507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f72bda03e74c2286ccaadba5fff35d', 'request_id': 'req-b652bc92-2da1-422b-81dc-aa92b4797a8e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:52.463415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f72bda03e74c2286ccaadba5fff35d', 'request_id': 'req-b652bc92-2da1-422b-81dc-aa92b4797a8e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:52.540806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] The token cache is being invalidate because project d5f72bda03e74c2286ccaadba5fff35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:52.541019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:52.541662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b652bc92-2da1-422b-81dc-aa92b4797a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:52.543127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1288/2538] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:52 2022] DELETE /identity/v3/projects/d5f72bda03e74c2286ccaadba5fff35d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:52.548372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a68f8-58c9-4369-8800-0a2469ddacb4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:52.548837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a68f8-58c9-4369-8800-0a2469ddacb4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:52.548936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a68f8-58c9-4369-8800-0a2469ddacb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:52.569624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-f97a68f8-58c9-4369-8800-0a2469ddacb4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:52.570828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-f97a68f8-58c9-4369-8800-0a2469ddacb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:52.633633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1251/2539] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:52.643938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7756ec-28db-4539-9b00-2b76567f4f0e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:52.644360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7756ec-28db-4539-9b00-2b76567f4f0e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:52.644707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7756ec-28db-4539-9b00-2b76567f4f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:52.668186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-cb7756ec-28db-4539-9b00-2b76567f4f0e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:52.669545 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-cb7756ec-28db-4539-9b00-2b76567f4f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:52.683424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1289/2540] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:52.686019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a68f8-58c9-4369-8800-0a2469ddacb4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:52.695780 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a68f8-58c9-4369-8800-0a2469ddacb4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:52.700451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:52.701009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:52.701311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:52.701583 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:52.702976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:52.703279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:52.704865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:52.716693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1252/2541] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:44:52.722512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7756ec-28db-4539-9b00-2b76567f4f0e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:52.731685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7756ec-28db-4539-9b00-2b76567f4f0e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:52.736648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:52.737268 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:52.737543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:52.737817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:52.740534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:52.740534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:52.754974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:52.824461 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1290/2542] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:52 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:52.829024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:52.840455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7d36b-3404-4d7a-b080-36c848165735 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:52.849629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:52.897722 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:52.898341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:52.898615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:52.898882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:52.899500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:52.901445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:52.974240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1253/2543] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:52 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:52.978377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:52.988964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa03d47-5296-4df2-9960-278d5a758df3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:52.993548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:52.994165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:52.994422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:52.996500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:52.996500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:52.996903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.008090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1291/2544] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:53.012052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:53.022793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048b322-c404-4e62-82f8-829b6871272d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:53.027509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842a53c-7f61-4fad-a11b-76874ffab122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:53.028100 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a53c-7f61-4fad-a11b-76874ffab122 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.028379 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a53c-7f61-4fad-a11b-76874ffab122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.028653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a53c-7f61-4fad-a11b-76874ffab122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.029376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842a53c-7f61-4fad-a11b-76874ffab122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:53.031103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842a53c-7f61-4fad-a11b-76874ffab122 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.042973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1254/2545] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:53.053383 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:53.064763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40a94-7b1d-44ba-a645-4dd96610901b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:53.069761 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:53.070417 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.070723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.071025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] PATH_INFO: `/v3/projects/24b28b865c5c4faca18af4745c782145/users/e849e771428a484da4fc33f4a2c18852/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.086854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b28b865c5c4faca18af4745c782145, user_id=e849e771428a484da4fc33f4a2c18852, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:53.089541 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.179715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1292/2546] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:53 2022] PUT /identity/v3/projects/24b28b865c5c4faca18af4745c782145/users/e849e771428a484da4fc33f4a2c18852/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:53.190330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90130e-0642-4348-92d1-4c08c73efdeb None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.190612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90130e-0642-4348-92d1-4c08c73efdeb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.190902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90130e-0642-4348-92d1-4c08c73efdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.219150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-9c90130e-0642-4348-92d1-4c08c73efdeb None None] MFA Rules not processed for user `e849e771428a484da4fc33f4a2c18852`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:53.220367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9c90130e-0642-4348-92d1-4c08c73efdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:53.284295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1255/2547] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:53.289678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:53.358572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30453f-be42-434d-a588-5531ee0a62f0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:53.363282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:53.363888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.368464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.368464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.368464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:53.368464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.498668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1293/2548] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:53 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:53.498841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90130e-0642-4348-92d1-4c08c73efdeb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:53.509335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90130e-0642-4348-92d1-4c08c73efdeb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:53.579213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:53.579853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.580133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.580407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.581055 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:53.582978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.701789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1256/2549] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:53 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:44:53.706534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:53.716644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe661-6a41-4fde-9838-3a10b64b8c75 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:53.721179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:53.721767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.722043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.722311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.722966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:53.724535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.735279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1294/2550] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:53.739344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:53.749994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc78bdb-8a74-4ff7-ba8c-593be549f6c8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:53.757578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:53.758246 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.758527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.758799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] PATH_INFO: `/v3/projects/c65aeb0e2f854d2ab14a4e18fe86e563/users/aba487fa0201413ca8c6f8b0b3ab2987/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.768541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:53.775228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65aeb0e2f854d2ab14a4e18fe86e563, user_id=aba487fa0201413ca8c6f8b0b3ab2987, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:53.778135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.897999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1257/2551] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:53 2022] PUT /identity/v3/projects/c65aeb0e2f854d2ab14a4e18fe86e563/users/aba487fa0201413ca8c6f8b0b3ab2987/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:53.901678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:53.911891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14c0e-e576-41f5-9f12-992c15c1e547 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:53.973242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d50f5b-84cc-4b1a-8c5c-00dc9d9c7bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:53.973849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d50f5b-84cc-4b1a-8c5c-00dc9d9c7bec admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:53.974129 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d50f5b-84cc-4b1a-8c5c-00dc9d9c7bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:53.974400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d50f5b-84cc-4b1a-8c5c-00dc9d9c7bec admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:53.975033 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d50f5b-84cc-4b1a-8c5c-00dc9d9c7bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:53.976682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d50f5b-84cc-4b1a-8c5c-00dc9d9c7bec admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:53.987471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1295/2552] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:53.992527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:54.004006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1baa77-fadf-4fdf-b381-32643a10de9b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:54.009637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:54.013827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:54.013827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:54.014051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] PATH_INFO: `/v3/projects/c65aeb0e2f854d2ab14a4e18fe86e563/users/aba487fa0201413ca8c6f8b0b3ab2987/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:54.016010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65aeb0e2f854d2ab14a4e18fe86e563, user_id=aba487fa0201413ca8c6f8b0b3ab2987, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:54.018891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:54.030386 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1258/2553] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:53 2022] PUT /identity/v3/projects/c65aeb0e2f854d2ab14a4e18fe86e563/users/aba487fa0201413ca8c6f8b0b3ab2987/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:54.041274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:54.041565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:54.041841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:54.073997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] MFA Rules not processed for user `aba487fa0201413ca8c6f8b0b3ab2987`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:54.075211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:54.091965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:54.142127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1296/2554] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:54.382423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:54.384168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:54.447653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed8a88-0065-4a59-822b-1e114545ac74 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:54.451385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:54.452049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:54.452441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:54.452799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:54.462126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:54.463565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:54.484431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1259/2555] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:54.715638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:54.717006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:54.730280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aca4c-17e3-4209-a5d3-3074095b5ef2 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:54.734047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a316d5-2292-4936-ae26-b1f3b69e749b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:54.734715 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a316d5-2292-4936-ae26-b1f3b69e749b service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:54.734994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a316d5-2292-4936-ae26-b1f3b69e749b service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:54.735265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a316d5-2292-4936-ae26-b1f3b69e749b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:54.791554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a316d5-2292-4936-ae26-b1f3b69e749b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:54.793109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a316d5-2292-4936-ae26-b1f3b69e749b service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:54.802315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1297/2556] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:56.034254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:56.035791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:56.101807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fa03a-c2d2-4176-b169-360fffd2b1e8 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:56.106860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:56.107493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:56.109385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:56.109385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] PATH_INFO: `/v3/users/4c5c1f6be3514116b588e7ce14efa672` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:56.110433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5c1f6be3514116b588e7ce14efa672)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:56.112347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:56.339840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5c1f6be3514116b588e7ce14efa672'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:56.340481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5c1f6be3514116b588e7ce14efa672'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:56.350361 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5c1f6be3514116b588e7ce14efa672'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:56.363637 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5c1f6be3514116b588e7ce14efa672'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:56.368062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5c1f6be3514116b588e7ce14efa672'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:56.368717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:56.479107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1260/2557] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:56 2022] DELETE /identity/v3/users/4c5c1f6be3514116b588e7ce14efa672 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:56.483984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:56.484441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:56.484564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:56.503360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:56.504633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:56.562806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1298/2558] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:56.572592 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:56.573998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:56.631044 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170d097-0f03-4602-83de-332df2ffacb3 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:56.634656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:56.635294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:56.635572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:56.635844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:56.645461 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:56.646888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:56.656358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1261/2559] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:57.220135 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:57.222636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:57.239535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74617a4-23c9-4b50-8eec-8bb4d3e40ab7 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:57.245601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:57.246257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:57.246537 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:57.246813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] PATH_INFO: `/v3/projects/d0a6bf2480874454bca8fd22adf5d071` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:57.247962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a6bf2480874454bca8fd22adf5d071)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:57.250832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:57.397434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:57.399290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a6bf2480874454bca8fd22adf5d071', 'request_id': 'req-3c30d22b-6c6c-47bb-9d47-f51f430cb778'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.407380 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a6bf2480874454bca8fd22adf5d071', 'request_id': 'req-3c30d22b-6c6c-47bb-9d47-f51f430cb778'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.415019 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a6bf2480874454bca8fd22adf5d071', 'request_id': 'req-3c30d22b-6c6c-47bb-9d47-f51f430cb778'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.521969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] The token cache is being invalidate because project d0a6bf2480874454bca8fd22adf5d071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:57.522593 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.522931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.524429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1299/2560] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:57 2022] DELETE /identity/v3/projects/d0a6bf2480874454bca8fd22adf5d071 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:57.534414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:57.539104 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:57.540572 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:57.544266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd296e-ac04-41dc-9b19-ce69a0f12ac9 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:57.602374 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:57.603194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:57.603402 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:57.603674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] PATH_INFO: `/v3/users/5233f36db441419c82ae08e950991781` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:57.604789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5233f36db441419c82ae08e950991781)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:57.606274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30d22b-6c6c-47bb-9d47-f51f430cb778 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:57.606763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:57.612074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:57.612690 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:57.612969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:57.613299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] PATH_INFO: `/v3/users/65aefd768c0e4914a1848ec5303a58f8` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:57.614466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65aefd768c0e4914a1848ec5303a58f8)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:57.616427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:57.833436 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5233f36db441419c82ae08e950991781'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.833689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65aefd768c0e4914a1848ec5303a58f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.834096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5233f36db441419c82ae08e950991781'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.840369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65aefd768c0e4914a1848ec5303a58f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.841001 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5233f36db441419c82ae08e950991781'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.855002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5233f36db441419c82ae08e950991781'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.855682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5233f36db441419c82ae08e950991781'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.930234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65aefd768c0e4914a1848ec5303a58f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.942756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65aefd768c0e4914a1848ec5303a58f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.943429 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-548f6c84-be5d-42df-ad62-9f8553556108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65aefd768c0e4914a1848ec5303a58f8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:57.949854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1300/2561] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:57 2022] DELETE /identity/v3/users/65aefd768c0e4914a1848ec5303a58f8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:57.954723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:57.955008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:57.955283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:57.974497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:57.975712 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:58.013552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1262/2562] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:57 2022] DELETE /identity/v3/users/5233f36db441419c82ae08e950991781 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:58.035776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1301/2563] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:58.045940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:58.048228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:58.069563 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:58.088548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:58.110923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff7d7-c800-4e0c-b2c5-b2979dcac36f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:58.114671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:58.115276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:58.115549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:58.115841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:58.175910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:58.177405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:58.187651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1263/2564] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:44:58.673345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:58.675157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:58.688137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4e38-094a-4867-9d1b-79451e3df4e9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:58.704183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:58.705073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:58.705256 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:58.705987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] PATH_INFO: `/v3/projects/9bfdab0bb6fe434ba4f54fa06ead0f40` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:58.707320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfdab0bb6fe434ba4f54fa06ead0f40)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:58.709591 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:58.833341 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:58.835458 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:58.847792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfdab0bb6fe434ba4f54fa06ead0f40', 'request_id': 'req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:58.856472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfdab0bb6fe434ba4f54fa06ead0f40', 'request_id': 'req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:58.868414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0f47-fda2-4aab-8f3e-6ebea6dcddd7 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:58.872865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfdab0bb6fe434ba4f54fa06ead0f40', 'request_id': 'req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:58.933954 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:58.934619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:58.934895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:58.935157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] PATH_INFO: `/v3/projects/d3ba441361c1406db19951061750718f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:58.936315 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ba441361c1406db19951061750718f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:58.938650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:58.991680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] The token cache is being invalidate because project 9bfdab0bb6fe434ba4f54fa06ead0f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:58.992005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:58.992938 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-010c9a16-4af9-40b5-9f62-cc1b4f15baf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:58.994532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1302/2565] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:58 2022] DELETE /identity/v3/projects/9bfdab0bb6fe434ba4f54fa06ead0f40 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:58.999492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a61ce-e637-4d1a-9373-71f3b7fcbc87 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.000122 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a61ce-e637-4d1a-9373-71f3b7fcbc87 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.000634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a61ce-e637-4d1a-9373-71f3b7fcbc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.021659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-863a61ce-e637-4d1a-9373-71f3b7fcbc87 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:59.022997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-863a61ce-e637-4d1a-9373-71f3b7fcbc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:59.031557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1303/2566] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:59.039673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60734f-18f0-4f82-adf5-0083a4490c39 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.039957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60734f-18f0-4f82-adf5-0083a4490c39 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.040229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60734f-18f0-4f82-adf5-0083a4490c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.059980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0a60734f-18f0-4f82-adf5-0083a4490c39 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:59.068372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0a60734f-18f0-4f82-adf5-0083a4490c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:59.072169 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ba441361c1406db19951061750718f', 'request_id': 'req-2b5e9518-c563-4698-8adf-98a48ed19bd1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.122604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1304/2567] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:44:59.126969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60734f-18f0-4f82-adf5-0083a4490c39 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.135846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60734f-18f0-4f82-adf5-0083a4490c39 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:59.140629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:59.141259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.141535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.141808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.142447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:44:59.142748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:59.144371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:59.158574 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1305/2568] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:44:59.162991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.163175 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ba441361c1406db19951061750718f', 'request_id': 'req-2b5e9518-c563-4698-8adf-98a48ed19bd1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.169958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ba441361c1406db19951061750718f', 'request_id': 'req-2b5e9518-c563-4698-8adf-98a48ed19bd1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.174288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a00d6-ce6d-4c78-b111-a4df5e6296fc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:59.178139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:59.178997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:59.179584 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.179860 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.180130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.180749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:59.182662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:59.182868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] The token cache is being invalidate because project d3ba441361c1406db19951061750718f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:44:59.183254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.186251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.191137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1264/2569] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:44:58 2022] DELETE /identity/v3/projects/d3ba441361c1406db19951061750718f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:59.191681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.193241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:59.206938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e9518-c563-4698-8adf-98a48ed19bd1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:59.212982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:59.214102 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.214723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.215215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] PATH_INFO: `/v3/users/8c84aa51d10446afaef2bb09631f0964` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.216874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c84aa51d10446afaef2bb09631f0964)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:59.219672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:59.364932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1306/2570] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:44:59 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:59.366424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.368233 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:59.411228 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:44:59.433143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aeefd-4a14-44b2-beba-f0f39e745645 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:59.437916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:59.438518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.438786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.439055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.439682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:59.441657 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:59.441863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c84aa51d10446afaef2bb09631f0964'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.443130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c84aa51d10446afaef2bb09631f0964'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.450552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c84aa51d10446afaef2bb09631f0964'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.464612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c84aa51d10446afaef2bb09631f0964'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.465435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c84aa51d10446afaef2bb09631f0964'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:44:59.540265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1307/2571] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:44:59 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:44:59.540419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1265/2572] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:44:59 2022] DELETE /identity/v3/users/8c84aa51d10446afaef2bb09631f0964 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:44:59.543444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.544495 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:59.563692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149aa1-647e-4db8-b293-fb741b9b50a4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:59.634176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:59.635668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.636204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.636726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.637991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:59.643863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:59.660997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1308/2573] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:44:59.662709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.678477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e922-fa37-44a0-a4cb-629a3e59929b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:59.694005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2aff18-cabb-4ae2-8cf3-48d5e0bf2538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:59.694005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aff18-cabb-4ae2-8cf3-48d5e0bf2538 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.694005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aff18-cabb-4ae2-8cf3-48d5e0bf2538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.694005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aff18-cabb-4ae2-8cf3-48d5e0bf2538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.694432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2aff18-cabb-4ae2-8cf3-48d5e0bf2538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:59.694432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2aff18-cabb-4ae2-8cf3-48d5e0bf2538 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:59.707338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1266/2574] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:44:59.708275 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.718447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2e00-4b9c-4294-b2e6-1cddce02a9e0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:44:59.723278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:44:59.723975 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.724252 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.724525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] PATH_INFO: `/v3/projects/9894b48dfb61422bb3bdf60594e38ad9/users/61b8f731ed0a46249efacad2c91ea0b1/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.739582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9894b48dfb61422bb3bdf60594e38ad9, user_id=61b8f731ed0a46249efacad2c91ea0b1, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:44:59.742393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:44:59.822543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1309/2575] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:44:59 2022] PUT /identity/v3/projects/9894b48dfb61422bb3bdf60594e38ad9/users/61b8f731ed0a46249efacad2c91ea0b1/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:44:59.833462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:44:59.833966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:44:59.834156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:44:59.864401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] MFA Rules not processed for user `61b8f731ed0a46249efacad2c91ea0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:44:59.865682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:44:59.938365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1267/2576] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:44:59.950579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:44:59.958682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:00.009901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e6597-541a-42d4-8c2d-056e43b1952a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:00.013901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f4eb6-cb4c-42e0-8017-00978b2fcedd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:00.014616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4eb6-cb4c-42e0-8017-00978b2fcedd service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.018058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4eb6-cb4c-42e0-8017-00978b2fcedd service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.018058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f4eb6-cb4c-42e0-8017-00978b2fcedd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.018276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:00.018909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:00.025638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f4eb6-cb4c-42e0-8017-00978b2fcedd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:00.027251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f4eb6-cb4c-42e0-8017-00978b2fcedd service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:00.038552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1310/2577] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:44:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:00.081730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:00.092787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf2d28-c431-4aba-9365-58984c28010e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:00.097705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:00.098346 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.098630 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.098903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] PATH_INFO: `/v3/projects/9d3be22f3b1c43b2aea322d204b52096` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.100166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3be22f3b1c43b2aea322d204b52096)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:00.102794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:00.244290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3be22f3b1c43b2aea322d204b52096', 'request_id': 'req-9c2336a3-08cf-403d-baa8-c8985b0f79d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:00.373428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3be22f3b1c43b2aea322d204b52096', 'request_id': 'req-9c2336a3-08cf-403d-baa8-c8985b0f79d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:00.380726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3be22f3b1c43b2aea322d204b52096', 'request_id': 'req-9c2336a3-08cf-403d-baa8-c8985b0f79d6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:00.392042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] The token cache is being invalidate because project 9d3be22f3b1c43b2aea322d204b52096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:00.392334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:00.392992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9c2336a3-08cf-403d-baa8-c8985b0f79d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:00.394547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1268/2578] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:00 2022] DELETE /identity/v3/projects/9d3be22f3b1c43b2aea322d204b52096 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:00.399433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae397f8-3318-4b59-a401-7f48dc6da1ad None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.404994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae397f8-3318-4b59-a401-7f48dc6da1ad None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.404994 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae397f8-3318-4b59-a401-7f48dc6da1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.419988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-eae397f8-3318-4b59-a401-7f48dc6da1ad None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:00.421479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eae397f8-3318-4b59-a401-7f48dc6da1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:00.463639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:00.485746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1311/2579] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:00.493834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf1c4-4649-46c1-8f2c-b1d6664133c6 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.494119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf1c4-4649-46c1-8f2c-b1d6664133c6 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.494392 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf1c4-4649-46c1-8f2c-b1d6664133c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.516150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-eaadf1c4-4649-46c1-8f2c-b1d6664133c6 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:00.517560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-eaadf1c4-4649-46c1-8f2c-b1d6664133c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:00.525554 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1269/2580] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:00.529780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae397f8-3318-4b59-a401-7f48dc6da1ad None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:00.540042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae397f8-3318-4b59-a401-7f48dc6da1ad None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:00.544512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:00.545137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.545709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.545980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.547243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:00.547555 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:00.549416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:00.560907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1312/2581] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:00.565296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf1c4-4649-46c1-8f2c-b1d6664133c6 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:00.574535 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf1c4-4649-46c1-8f2c-b1d6664133c6 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:00.579886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:00.580514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.580789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.581088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.581710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:00.583611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:00.686312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1270/2582] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:00 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:00.691192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:00.701267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340f6c-10f1-4668-ae34-353c024dc56b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:00.764058 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:00.764681 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.764934 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.765718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.766588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:00.768472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:00.898564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1313/2583] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:00 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:00.902836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:00.931903 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8e2f8-169e-4c09-bbe3-f18a9f5b7a11 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:00.939227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:00.940250 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.940627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.940999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.941837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:00.943614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:00.956260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1271/2584] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:00.967166 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:00.979444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9063820-aa3e-47b7-b815-fc6e7804a2c1 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:00.984984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bb3d5-d48c-4c71-af31-738d43be75e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:00.988128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb3d5-d48c-4c71-af31-738d43be75e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:00.988128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb3d5-d48c-4c71-af31-738d43be75e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:00.988128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb3d5-d48c-4c71-af31-738d43be75e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:00.988128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bb3d5-d48c-4c71-af31-738d43be75e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:00.988508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bb3d5-d48c-4c71-af31-738d43be75e5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:00.998616 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1314/2585] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:01.003347 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:01.013515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919aeae-e07a-4ba2-bb40-cffbc4f3f095 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:01.018746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:01.019394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.019673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.019951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] PATH_INFO: `/v3/projects/8947d86f36d04455bc5101cb1c5db6c1/users/9fcec78bea8a472cb2a0ee0e5e5b57b1/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.035821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8947d86f36d04455bc5101cb1c5db6c1, user_id=9fcec78bea8a472cb2a0ee0e5e5b57b1, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:01.038524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:01.150825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1272/2586] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:01 2022] PUT /identity/v3/projects/8947d86f36d04455bc5101cb1c5db6c1/users/9fcec78bea8a472cb2a0ee0e5e5b57b1/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:01.162659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b84d2e-09ac-4a21-8881-b9464bbc08d5 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.162944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b84d2e-09ac-4a21-8881-b9464bbc08d5 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.163237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b84d2e-09ac-4a21-8881-b9464bbc08d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.191845 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-91b84d2e-09ac-4a21-8881-b9464bbc08d5 None None] MFA Rules not processed for user `9fcec78bea8a472cb2a0ee0e5e5b57b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:01.193070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-91b84d2e-09ac-4a21-8881-b9464bbc08d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:01.258947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1315/2587] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:01.263536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:01.331870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3967d-c27d-457a-a70d-ce0ad7921080 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:01.337122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:01.337730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.338863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.338863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.338863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:01.340812 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:01.457087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:01.463229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1273/2588] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:01 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:01.467472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b84d2e-09ac-4a21-8881-b9464bbc08d5 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:01.478005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b84d2e-09ac-4a21-8881-b9464bbc08d5 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:01.511783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:01.533836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:01.534440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.534716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.538440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.538440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:01.538440 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:01.614207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1316/2589] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:01 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:01.618365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:01.629337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec6fb8-7a11-411b-abdc-8c3d79ec0cf7 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:01.634486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:01.636013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.636013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.636013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.636283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:01.637840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:01.648254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1274/2590] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:01.652391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:01.662224 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f620aa-47ea-4fec-8e58-8116a343fceb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:01.666927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:01.667573 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.667854 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.668130 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] PATH_INFO: `/v3/projects/078eaf7cfc554cf5b177b8f296450dcb/users/cc194df7bb1d4aafa7316fd97a95f82a/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.683689 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078eaf7cfc554cf5b177b8f296450dcb, user_id=cc194df7bb1d4aafa7316fd97a95f82a, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:01.686585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:01.775668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1317/2591] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:01 2022] PUT /identity/v3/projects/078eaf7cfc554cf5b177b8f296450dcb/users/cc194df7bb1d4aafa7316fd97a95f82a/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:01.779652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:01.790082 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6be20-39b8-4a65-ac93-ff822bd466b5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:01.846932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8002884-da58-4c3c-ada4-0dc83dd71180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:01.847540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002884-da58-4c3c-ada4-0dc83dd71180 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.847819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002884-da58-4c3c-ada4-0dc83dd71180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.848088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002884-da58-4c3c-ada4-0dc83dd71180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.848754 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002884-da58-4c3c-ada4-0dc83dd71180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:01.850419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002884-da58-4c3c-ada4-0dc83dd71180 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:01.861706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1275/2592] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:01.866015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:01.876839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842e2ce-7e71-400e-9acc-556765a6c5c8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:01.882286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:01.882937 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.883216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.883489 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] PATH_INFO: `/v3/projects/078eaf7cfc554cf5b177b8f296450dcb/users/cc194df7bb1d4aafa7316fd97a95f82a/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.885432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078eaf7cfc554cf5b177b8f296450dcb, user_id=cc194df7bb1d4aafa7316fd97a95f82a, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:01.888116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:01.899403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1318/2593] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:01 2022] PUT /identity/v3/projects/078eaf7cfc554cf5b177b8f296450dcb/users/cc194df7bb1d4aafa7316fd97a95f82a/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:01.910692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:01.911183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:01.911283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:01.940760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] MFA Rules not processed for user `cc194df7bb1d4aafa7316fd97a95f82a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:01.941987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:02.014037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1276/2594] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:02.030665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:02.030665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:02.086610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1275ed7-e23f-4316-83ae-fcb6aa30c9b7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:02.090285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c2645-4867-4113-a443-7d4d254f53d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:02.090891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c2645-4867-4113-a443-7d4d254f53d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:02.091168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c2645-4867-4113-a443-7d4d254f53d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:02.091452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c2645-4867-4113-a443-7d4d254f53d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:02.150481 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c2645-4867-4113-a443-7d4d254f53d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:02.152006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c2645-4867-4113-a443-7d4d254f53d6 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:02.162839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1319/2595] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:04.444404 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:04.445824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:04.516955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad8e0b-3840-4609-bf5c-adcb2f86a102 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:04.521560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:04.522223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:04.522501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:04.522771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] PATH_INFO: `/v3/users/e849e771428a484da4fc33f4a2c18852` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:04.524064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e849e771428a484da4fc33f4a2c18852)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:04.525825 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:04.539298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:04.759217 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e849e771428a484da4fc33f4a2c18852'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:04.759814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e849e771428a484da4fc33f4a2c18852'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:04.767008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e849e771428a484da4fc33f4a2c18852'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:04.779247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e849e771428a484da4fc33f4a2c18852'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:04.782424 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e849e771428a484da4fc33f4a2c18852'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:04.876454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1277/2596] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:04 2022] DELETE /identity/v3/users/e849e771428a484da4fc33f4a2c18852 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:04.881063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:04.884751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:04.884751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:04.900642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:04.901852 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:04.944128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:04.964968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1320/2597] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:04.975849 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:04.977320 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:05.037368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348eb321-c1a0-430a-a509-99babb8db13e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:05.040922 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:05.041556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:05.041839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:05.042114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:05.052561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:05.054027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:05.063567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1278/2598] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:05.480148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:05.481829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:05.496201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d315a-b4a5-4626-ac7c-c4e1e55c72f0 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:05.500356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:05.501284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:05.501621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:05.501904 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] PATH_INFO: `/v3/projects/24b28b865c5c4faca18af4745c782145` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:05.503205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b28b865c5c4faca18af4745c782145)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:05.505506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:05.574449 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:05.575792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:05.633149 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907aec0-c446-44fb-a32f-d88d60e62eba service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:05.639262 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b28b865c5c4faca18af4745c782145', 'request_id': 'req-d3ab55d5-a106-4d7b-832d-4fde60df8748'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:05.645771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b28b865c5c4faca18af4745c782145', 'request_id': 'req-d3ab55d5-a106-4d7b-832d-4fde60df8748'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:05.651954 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b28b865c5c4faca18af4745c782145', 'request_id': 'req-d3ab55d5-a106-4d7b-832d-4fde60df8748'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:05.678960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:05.683328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:05.683932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:05.684212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:05.684486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:05.686326 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:05.738951 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] The token cache is being invalidate because project 24b28b865c5c4faca18af4745c782145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:05.739506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:05.740139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:05.741643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1321/2599] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:05 2022] DELETE /identity/v3/projects/24b28b865c5c4faca18af4745c782145 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:05.745394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:05.746674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:05.748446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:05.749982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:05.761689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1279/2600] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:05.815818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab55d5-a106-4d7b-832d-4fde60df8748 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:05.820430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:05.821101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:05.821382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:05.821652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] PATH_INFO: `/v3/users/aba487fa0201413ca8c6f8b0b3ab2987` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:05.822778 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba487fa0201413ca8c6f8b0b3ab2987)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:05.824714 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:06.010484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba487fa0201413ca8c6f8b0b3ab2987'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.017826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba487fa0201413ca8c6f8b0b3ab2987'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.111754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba487fa0201413ca8c6f8b0b3ab2987'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.118035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:06.127222 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba487fa0201413ca8c6f8b0b3ab2987'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.128244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b0988d22-c0ae-4370-94b2-940e072e8d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba487fa0201413ca8c6f8b0b3ab2987'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.134637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1322/2601] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:05 2022] DELETE /identity/v3/users/aba487fa0201413ca8c6f8b0b3ab2987 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:06.558025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:06.559419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1abf6c-16b1-4d6b-96ff-1281962d6a19 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:06.616863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:06.617542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:06.617715 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:06.617986 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] PATH_INFO: `/v3/projects/c65aeb0e2f854d2ab14a4e18fe86e563` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:06.619093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65aeb0e2f854d2ab14a4e18fe86e563)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:06.621050 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:06.742372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65aeb0e2f854d2ab14a4e18fe86e563', 'request_id': 'req-90edaa51-8e99-4173-90c6-c71951acb0e1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.821460 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65aeb0e2f854d2ab14a4e18fe86e563', 'request_id': 'req-90edaa51-8e99-4173-90c6-c71951acb0e1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.827463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65aeb0e2f854d2ab14a4e18fe86e563', 'request_id': 'req-90edaa51-8e99-4173-90c6-c71951acb0e1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.839425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] The token cache is being invalidate because project c65aeb0e2f854d2ab14a4e18fe86e563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:06.839713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.840365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-90edaa51-8e99-4173-90c6-c71951acb0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:06.841898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1280/2602] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:06 2022] DELETE /identity/v3/projects/c65aeb0e2f854d2ab14a4e18fe86e563 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:06.847562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e937-0247-4b22-ac09-b6c6772ee90a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:06.847857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e937-0247-4b22-ac09-b6c6772ee90a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:06.848138 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e937-0247-4b22-ac09-b6c6772ee90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:06.868109 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4196e937-0247-4b22-ac09-b6c6772ee90a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:06.869290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4196e937-0247-4b22-ac09-b6c6772ee90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:06.928082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1323/2603] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:06.936233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5367e6-4fb6-471a-b1ff-4b0ddb77b680 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:06.936523 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5367e6-4fb6-471a-b1ff-4b0ddb77b680 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:06.936796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5367e6-4fb6-471a-b1ff-4b0ddb77b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:06.956706 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-5b5367e6-4fb6-471a-b1ff-4b0ddb77b680 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:06.957931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5b5367e6-4fb6-471a-b1ff-4b0ddb77b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:06.965855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1281/2604] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:06.971446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196e937-0247-4b22-ac09-b6c6772ee90a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:06.981325 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196e937-0247-4b22-ac09-b6c6772ee90a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:06.986507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:06.987003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:06.987286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:06.987562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:06.988203 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:06.988510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:06.990128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:07.002085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1324/2605] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:07.006708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5367e6-4fb6-471a-b1ff-4b0ddb77b680 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:07.015895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5367e6-4fb6-471a-b1ff-4b0ddb77b680 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:07.021090 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:07.021685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.021964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.022256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.022927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:07.024814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:07.135620 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:07.142526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1282/2606] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:07 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:07.146725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:07.157706 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7e666-55ee-4fa7-9026-1d1ce14f1895 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:07.219255 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:07.220437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.220750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.221047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.221833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:07.223752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:07.353518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1325/2607] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:07 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:07.357758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:07.370447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5a57-8076-4d07-9048-9db19c5942ff admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:07.374897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:07.375485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.375766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.376709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.377210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:07.378792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:07.388655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1283/2608] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:07.393546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:07.403592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24ed4-12c9-4c2e-bc6a-9e37a6b75811 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:07.408237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745eb6ca-b0e9-4e6e-a56c-60753dfa33c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:07.408830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eb6ca-b0e9-4e6e-a56c-60753dfa33c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.409137 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eb6ca-b0e9-4e6e-a56c-60753dfa33c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.409517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eb6ca-b0e9-4e6e-a56c-60753dfa33c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.414513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745eb6ca-b0e9-4e6e-a56c-60753dfa33c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:07.414513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745eb6ca-b0e9-4e6e-a56c-60753dfa33c8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:07.422560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1326/2609] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:07.427264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:07.436994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c8f2-91e7-4b2c-b0e6-110d1ed1486f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:07.442719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:07.443388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.443671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.444909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] PATH_INFO: `/v3/projects/672ea43f80d543e39d1f4c23eb513035/users/4b9d40436b124b38ac4cec3beb682e30/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.460974 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672ea43f80d543e39d1f4c23eb513035, user_id=4b9d40436b124b38ac4cec3beb682e30, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:07.463972 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:07.534389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1284/2610] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:07 2022] PUT /identity/v3/projects/672ea43f80d543e39d1f4c23eb513035/users/4b9d40436b124b38ac4cec3beb682e30/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:07.544709 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7fc5-ad62-4f9f-ad17-dc32d7d9ad62 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.545204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7fc5-ad62-4f9f-ad17-dc32d7d9ad62 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.545740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7fc5-ad62-4f9f-ad17-dc32d7d9ad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.585680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b82c7fc5-ad62-4f9f-ad17-dc32d7d9ad62 None None] MFA Rules not processed for user `4b9d40436b124b38ac4cec3beb682e30`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:07.586894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b82c7fc5-ad62-4f9f-ad17-dc32d7d9ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:07.633867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:07.659738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1327/2611] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:07.664397 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:07.729060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1711-58fd-4381-aa42-e4568b6e3693 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:07.734021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:07.734629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.734905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.735177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.735852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:07.740310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:07.846183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1285/2612] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:07 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:07.850287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7fc5-ad62-4f9f-ad17-dc32d7d9ad62 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:07.860877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7fc5-ad62-4f9f-ad17-dc32d7d9ad62 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:07.916795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:07.917371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:07.917652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:07.917946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:07.918586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:07.925738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.009291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1328/2613] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:07 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:08.012711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.023796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbca48-bc62-4d54-ae55-065db33e02d2 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.028435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.029664 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.029945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.034869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.034869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.034869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.044332 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1286/2614] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:08.048701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.058654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23d85-1ee2-4cf0-8dcb-0e716eaf7c67 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.063369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbce9c5-54e7-4c45-9798-c5445afced2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.069244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce9c5-54e7-4c45-9798-c5445afced2b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.069244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce9c5-54e7-4c45-9798-c5445afced2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.069244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce9c5-54e7-4c45-9798-c5445afced2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.069244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbce9c5-54e7-4c45-9798-c5445afced2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.069244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbce9c5-54e7-4c45-9798-c5445afced2b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.077959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1329/2615] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:08.083052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.093261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2383602-1031-47b9-a54d-61a4a009053c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.097888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.098528 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.098806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.099080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] PATH_INFO: `/v3/projects/301f803dab174acebb1a04572eda58f1/users/9de84874fc8942a1897cbbc746dae0d9/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.113610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301f803dab174acebb1a04572eda58f1, user_id=9de84874fc8942a1897cbbc746dae0d9, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.116435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.255372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1287/2616] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:08 2022] PUT /identity/v3/projects/301f803dab174acebb1a04572eda58f1/users/9de84874fc8942a1897cbbc746dae0d9/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:08.266745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca830-dcb4-4017-b241-77703569b102 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.267229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca830-dcb4-4017-b241-77703569b102 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.267381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca830-dcb4-4017-b241-77703569b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.296521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-856ca830-dcb4-4017-b241-77703569b102 None None] MFA Rules not processed for user `9de84874fc8942a1897cbbc746dae0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:08.297810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-856ca830-dcb4-4017-b241-77703569b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:08.364055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1330/2617] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:08.368809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.432542 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16bd7c-3c4f-46b2-a246-5f48034f1cf4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.437556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.438236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.438514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.438782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.440060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.442008 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.531252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:08.537982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1288/2618] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:08 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:08.542076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ca830-dcb4-4017-b241-77703569b102 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.553902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ca830-dcb4-4017-b241-77703569b102 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.601285 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:08.610794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.612006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.612309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.612578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.613229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.615127 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.718446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1331/2619] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:08 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:08.723087 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.733850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94589308-7a0b-4ec5-bc1f-1d6717e8d987 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.742918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.743409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.743409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.754570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1289/2620] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:08.758674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.768678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f295c-3c61-41d4-a88a-848cbbc07c68 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.773266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.773911 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.774189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.774464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] PATH_INFO: `/v3/projects/b3e3d5a2ec1c49a093772a6c220ffd43/users/a53010644ac7430ca5dcc550a127dbf9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.790052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e3d5a2ec1c49a093772a6c220ffd43, user_id=a53010644ac7430ca5dcc550a127dbf9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.792726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.888074 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1332/2621] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:08 2022] PUT /identity/v3/projects/b3e3d5a2ec1c49a093772a6c220ffd43/users/a53010644ac7430ca5dcc550a127dbf9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:08.892689 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.902749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb2a83-2565-49c8-b3f9-a24f44dc14e4 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.959869 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76b40d-92b9-4b94-8638-bc88c1cf2edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.960485 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76b40d-92b9-4b94-8638-bc88c1cf2edc admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.960770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76b40d-92b9-4b94-8638-bc88c1cf2edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.961068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76b40d-92b9-4b94-8638-bc88c1cf2edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.961712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76b40d-92b9-4b94-8638-bc88c1cf2edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:08.963434 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76b40d-92b9-4b94-8638-bc88c1cf2edc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:08.977268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1290/2622] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:08.978662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:08.990047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b23d87-d24b-401d-945f-767b9e5dec1e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:08.995082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:08.995760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:08.996035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:08.996302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] PATH_INFO: `/v3/projects/b3e3d5a2ec1c49a093772a6c220ffd43/users/a53010644ac7430ca5dcc550a127dbf9/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:08.998263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e3d5a2ec1c49a093772a6c220ffd43, user_id=a53010644ac7430ca5dcc550a127dbf9, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:09.000873 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:09.011686 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1333/2623] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:08 2022] PUT /identity/v3/projects/b3e3d5a2ec1c49a093772a6c220ffd43/users/a53010644ac7430ca5dcc550a127dbf9/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:09.022625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:09.022920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:09.023203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:09.052462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] MFA Rules not processed for user `a53010644ac7430ca5dcc550a127dbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:09.053727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:09.127099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1291/2624] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:09.144796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:09.147012 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:09.211278 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb3b88-dec4-44cc-9eca-d843d196c4c5 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:09.215032 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:09.215644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:09.215923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:09.216195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:09.226269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:09.227627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:09.236962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1334/2625] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:10.817861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:10.819853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:10.833662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b0b25-caff-467e-8a2c-72dbc655bce8 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:10.837521 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f398-c66b-4c01-a355-879f08fdfffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:10.838135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f398-c66b-4c01-a355-879f08fdfffa service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:10.838431 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f398-c66b-4c01-a355-879f08fdfffa service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:10.839372 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f398-c66b-4c01-a355-879f08fdfffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:10.910568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f398-c66b-4c01-a355-879f08fdfffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:10.911958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f398-c66b-4c01-a355-879f08fdfffa service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:10.922655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1292/2626] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:15.613620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:15.615011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:15.678530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ece38-bddc-44f4-9677-7548cf4b08ef service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:15.683001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:15.683623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:15.683898 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:15.684169 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] PATH_INFO: `/v3/users/61b8f731ed0a46249efacad2c91ea0b1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:15.685293 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b8f731ed0a46249efacad2c91ea0b1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:15.687236 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:15.902427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b8f731ed0a46249efacad2c91ea0b1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:15.903606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:15.909908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b8f731ed0a46249efacad2c91ea0b1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:15.996510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b8f731ed0a46249efacad2c91ea0b1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.010403 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b8f731ed0a46249efacad2c91ea0b1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.011062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b8f731ed0a46249efacad2c91ea0b1'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.016891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1335/2627] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:15 2022] DELETE /identity/v3/users/61b8f731ed0a46249efacad2c91ea0b1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:16.022222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:16.022712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:16.022810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:16.041796 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:16.042982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:16.047093 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:16.095585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:16.097142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:16.106558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1293/2628] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:16.119427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:16.120970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:16.159072 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028de31c-41f5-4034-9aa5-d8fc56e61072 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:16.163186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ea7c-0ca3-4b4e-bc32-1af89adb3fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:16.163796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ea7c-0ca3-4b4e-bc32-1af89adb3fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:16.164082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ea7c-0ca3-4b4e-bc32-1af89adb3fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:16.164343 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ea7c-0ca3-4b4e-bc32-1af89adb3fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:16.166112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5485ea7c-0ca3-4b4e-bc32-1af89adb3fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:16.186657 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d47c7-6dee-4c69-a79f-f4e7a5f84d67 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:16.190242 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:16.190842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:16.191120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:16.191388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:16.201446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:16.202930 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:16.214540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1294/2629] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:16.235025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ea7c-0ca3-4b4e-bc32-1af89adb3fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:16.236467 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ea7c-0ca3-4b4e-bc32-1af89adb3fa1 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:16.247415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1336/2630] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:45:16.697084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:16.698507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:16.711639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d71b9-974d-462b-9d77-03ba0aa26618 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:16.716366 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:16.716994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:16.717173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:16.717444 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] PATH_INFO: `/v3/projects/9894b48dfb61422bb3bdf60594e38ad9` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:16.718547 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9894b48dfb61422bb3bdf60594e38ad9)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:16.720475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:16.842159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9894b48dfb61422bb3bdf60594e38ad9', 'request_id': 'req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.930811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9894b48dfb61422bb3bdf60594e38ad9', 'request_id': 'req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.936772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9894b48dfb61422bb3bdf60594e38ad9', 'request_id': 'req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.948215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] The token cache is being invalidate because project 9894b48dfb61422bb3bdf60594e38ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:16.948525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.949235 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-5ca8407e-0c2e-4bcd-9f5f-d99bdbdb4a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:16.950789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1295/2631] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:16 2022] DELETE /identity/v3/projects/9894b48dfb61422bb3bdf60594e38ad9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:16.955907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45260f-761c-4ce9-b6ce-70117ee95fca None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:16.956420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45260f-761c-4ce9-b6ce-70117ee95fca None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:16.956548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45260f-761c-4ce9-b6ce-70117ee95fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:16.976360 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-8b45260f-761c-4ce9-b6ce-70117ee95fca None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:16.977568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8b45260f-761c-4ce9-b6ce-70117ee95fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:17.037766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1337/2632] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:17.106248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dca69b-a42b-40eb-9df9-dab56963c60f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.106837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dca69b-a42b-40eb-9df9-dab56963c60f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.106837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dca69b-a42b-40eb-9df9-dab56963c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.127506 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b5dca69b-a42b-40eb-9df9-dab56963c60f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:17.128719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b5dca69b-a42b-40eb-9df9-dab56963c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:17.137122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1296/2633] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:17.141759 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45260f-761c-4ce9-b6ce-70117ee95fca None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:17.152420 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45260f-761c-4ce9-b6ce-70117ee95fca None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:17.157115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:17.157781 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.158065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.158368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.159062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:17.159367 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:17.162348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:17.174435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1338/2634] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:17.179290 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dca69b-a42b-40eb-9df9-dab56963c60f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:17.188708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dca69b-a42b-40eb-9df9-dab56963c60f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:17.193966 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:17.194566 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.194845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.195116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.195814 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:17.197779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:17.326498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1297/2635] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:17 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:17.330704 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:17.341348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52b981-8406-4a9a-a3b6-ae0741fafd2b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:17.345567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:17.403235 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:17.403847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.404144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.404463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.405043 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:17.406970 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:17.543294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1339/2636] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:17 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:17.547371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:17.557834 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5892b-c9d1-4d48-9c65-521ac43eb112 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:17.562375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:17.562970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.563247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.563516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.564147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:17.565776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:17.567495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:17.576575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1298/2637] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:17.580605 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:17.591189 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9a5b1-77e2-432b-a7f5-dbd7be813613 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:17.595817 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7aee-d3a0-4e34-a388-30d4efa98f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:17.598053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7aee-d3a0-4e34-a388-30d4efa98f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.598053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7aee-d3a0-4e34-a388-30d4efa98f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.598053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7aee-d3a0-4e34-a388-30d4efa98f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.598053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db7aee-d3a0-4e34-a388-30d4efa98f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:17.599492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db7aee-d3a0-4e34-a388-30d4efa98f9a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:17.610195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1340/2638] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:17.615037 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:17.625002 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683e80-fcf7-4fd9-8b81-9e200e8dbb56 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:17.630643 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:17.631297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.631601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.631879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] PATH_INFO: `/v3/projects/a99a64a3166145899832a22548ff2a22/users/2c4504b2b5c1420eb00d17e9104c4e58/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.647131 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99a64a3166145899832a22548ff2a22, user_id=2c4504b2b5c1420eb00d17e9104c4e58, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:17.649829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:17.713644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1299/2639] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:17 2022] PUT /identity/v3/projects/a99a64a3166145899832a22548ff2a22/users/2c4504b2b5c1420eb00d17e9104c4e58/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:17.723946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715df74-5b03-4b79-8b85-9d1a6db98d23 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.724245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715df74-5b03-4b79-8b85-9d1a6db98d23 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.724527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715df74-5b03-4b79-8b85-9d1a6db98d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.753861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-4715df74-5b03-4b79-8b85-9d1a6db98d23 None None] MFA Rules not processed for user `2c4504b2b5c1420eb00d17e9104c4e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:17.756952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4715df74-5b03-4b79-8b85-9d1a6db98d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:17.833813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1341/2640] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:17.833950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:17.909600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267438dd-6c8a-4a7c-ba78-68057caea242 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:17.915589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:17.915809 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:17.916095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:17.916370 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:17.917003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:17.919208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.026949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1300/2641] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:17 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:18.028301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715df74-5b03-4b79-8b85-9d1a6db98d23 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.039077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715df74-5b03-4b79-8b85-9d1a6db98d23 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.096476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.097243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.097522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.097929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.098478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.100416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.229328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1342/2642] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:18 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:18.231533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.244625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcad3a-ed5a-4b78-a430-1c186c15ae4d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.248005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.248604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.248968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.249418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.249980 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.251608 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.263256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1301/2643] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:18.267814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.274438 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:18.278437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45703c14-61f2-4563-8a12-2db0c7d7a60c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.282988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24373c-ed57-47fa-bcd6-eec7b945d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.283597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24373c-ed57-47fa-bcd6-eec7b945d96e admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.283868 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24373c-ed57-47fa-bcd6-eec7b945d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.286106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24373c-ed57-47fa-bcd6-eec7b945d96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.286106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24373c-ed57-47fa-bcd6-eec7b945d96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.287006 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24373c-ed57-47fa-bcd6-eec7b945d96e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.297124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1343/2644] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:18.302137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.312121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7625a-3de5-4e7d-a96f-5219b8916084 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.316599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.317399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.317610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.317884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] PATH_INFO: `/v3/projects/017f029f84774cf491b8656337d8e771/users/25cefc75376d4832a278ddeac8353a7f/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.332097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017f029f84774cf491b8656337d8e771, user_id=25cefc75376d4832a278ddeac8353a7f, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.334864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.425467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1302/2645] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:18 2022] PUT /identity/v3/projects/017f029f84774cf491b8656337d8e771/users/25cefc75376d4832a278ddeac8353a7f/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:18.435940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab5e4-541c-44a9-b777-ec24ee4c680c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.436223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab5e4-541c-44a9-b777-ec24ee4c680c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.436502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab5e4-541c-44a9-b777-ec24ee4c680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.466407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-357ab5e4-541c-44a9-b777-ec24ee4c680c None None] MFA Rules not processed for user `25cefc75376d4832a278ddeac8353a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:18.467636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-357ab5e4-541c-44a9-b777-ec24ee4c680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:18.531530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1344/2646] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:18.536135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.599559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013826ae-78d9-4d6a-943e-fc038a9bcef5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.605616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.606222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.606540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.606776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.607407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.609343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.698430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1303/2647] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:18 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:18.701923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab5e4-541c-44a9-b777-ec24ee4c680c None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.713303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab5e4-541c-44a9-b777-ec24ee4c680c None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.772322 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.772932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.773245 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.773523 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.774150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.776053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.874202 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1345/2648] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:18 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:18.875684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.886172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177ac0f-255f-4d53-a228-70143e810a1f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.890755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.891398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.891690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.891999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.892644 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.894322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:18.896201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:18.907116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1304/2649] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:18.912396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:18.922711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62b017-f0ca-4836-a7ff-883719d9b1e0 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:18.927540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:18.928177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:18.928496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:18.932722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] PATH_INFO: `/v3/projects/072f9267f94d4277ac84099cd37f5f2f/users/1f601660c3d2421bbc140af16a0e9f64/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:18.944453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=072f9267f94d4277ac84099cd37f5f2f, user_id=1f601660c3d2421bbc140af16a0e9f64, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:18.947176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:19.057213 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1346/2650] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:18 2022] PUT /identity/v3/projects/072f9267f94d4277ac84099cd37f5f2f/users/1f601660c3d2421bbc140af16a0e9f64/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:19.061303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:19.071408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29cc1-9bb2-440c-b216-71a6de843f67 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:19.250009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5acc0b-3745-4588-b3e3-bdff6d31ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:19.250719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5acc0b-3745-4588-b3e3-bdff6d31ae6e admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:19.250885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5acc0b-3745-4588-b3e3-bdff6d31ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:19.251158 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5acc0b-3745-4588-b3e3-bdff6d31ae6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:19.251826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5acc0b-3745-4588-b3e3-bdff6d31ae6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:19.253484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5acc0b-3745-4588-b3e3-bdff6d31ae6e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:19.263950 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1305/2651] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:19.268447 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:19.278878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5ad4-36e7-4215-bb59-66a38385cb6c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:19.287514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:19.288254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:19.288603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:19.288946 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] PATH_INFO: `/v3/projects/072f9267f94d4277ac84099cd37f5f2f/users/1f601660c3d2421bbc140af16a0e9f64/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:19.291013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=072f9267f94d4277ac84099cd37f5f2f, user_id=1f601660c3d2421bbc140af16a0e9f64, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:19.293908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:19.309090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1347/2652] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:19 2022] PUT /identity/v3/projects/072f9267f94d4277ac84099cd37f5f2f/users/1f601660c3d2421bbc140af16a0e9f64/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:19.327893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:19.328202 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:19.328575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:19.367899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] MFA Rules not processed for user `1f601660c3d2421bbc140af16a0e9f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:19.367899 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:19.438384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1306/2653] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:19.465956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:19.467653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:19.509277 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:19.527152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8fc90-6aaf-4860-b9f6-4feee214e26f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:19.530877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb2e92-701f-4dda-b26e-b1d27d670ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:19.531484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2e92-701f-4dda-b26e-b1d27d670ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:19.531765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2e92-701f-4dda-b26e-b1d27d670ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:19.532042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2e92-701f-4dda-b26e-b1d27d670ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:19.588708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb2e92-701f-4dda-b26e-b1d27d670ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:19.590100 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb2e92-701f-4dda-b26e-b1d27d670ca2 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:19.599364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1348/2654] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:20.858665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:20.860103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:20.930586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be6fce-33d2-4ba8-9151-2a40300b304b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:20.935040 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:20.935728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:20.935942 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:20.936211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] PATH_INFO: `/v3/users/4b9d40436b124b38ac4cec3beb682e30` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:20.937419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9d40436b124b38ac4cec3beb682e30)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:20.939322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:20.963237 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:21.142465 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9d40436b124b38ac4cec3beb682e30'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:21.143122 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9d40436b124b38ac4cec3beb682e30'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:21.150741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9d40436b124b38ac4cec3beb682e30'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:21.163299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9d40436b124b38ac4cec3beb682e30'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:21.163962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9d40436b124b38ac4cec3beb682e30'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:21.253778 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1307/2655] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:20 2022] DELETE /identity/v3/users/4b9d40436b124b38ac4cec3beb682e30 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:21.259154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:21.259607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:21.259797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:21.279553 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:21.280823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:21.339779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1349/2656] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:21.349985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:21.351399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:21.408249 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9297e0-9118-4e67-a691-c2648b246ebb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:21.412377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:21.413072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:21.413355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:21.413622 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:21.422667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:21.424085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:21.434159 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1308/2657] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:21.828329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:21.829753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:21.838943 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:21.840433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:21.855730 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9122-3eff-43cc-b100-dbfab5f487e7 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:21.860252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:21.860885 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:21.861205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:21.861675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] PATH_INFO: `/v3/projects/672ea43f80d543e39d1f4c23eb513035` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:21.862792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672ea43f80d543e39d1f4c23eb513035)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:21.864710 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:21.906713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4338f-ca20-46cc-b393-1d024db4aa73 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:21.910266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:21.910867 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:21.911142 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:21.912045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:21.913811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:21.960952 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=100 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:21.971025 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672ea43f80d543e39d1f4c23eb513035', 'request_id': 'req-0847321f-5cb9-4283-8a73-02ca708ffae9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:21.978415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:21.979859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:21.989084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1350/2658] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:22.044933 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672ea43f80d543e39d1f4c23eb513035', 'request_id': 'req-0847321f-5cb9-4283-8a73-02ca708ffae9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.051845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672ea43f80d543e39d1f4c23eb513035', 'request_id': 'req-0847321f-5cb9-4283-8a73-02ca708ffae9'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.064946 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] The token cache is being invalidate because project 672ea43f80d543e39d1f4c23eb513035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:22.065391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.066124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.068335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1309/2659] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:21 2022] DELETE /identity/v3/projects/672ea43f80d543e39d1f4c23eb513035 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:22.072823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:22.084289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150eace1-327d-4af9-847f-94938c02008c service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:22.140337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:22.140955 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:22.141272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:22.141540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] PATH_INFO: `/v3/users/9de84874fc8942a1897cbbc746dae0d9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:22.142654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de84874fc8942a1897cbbc746dae0d9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:22.144699 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:22.314008 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de84874fc8942a1897cbbc746dae0d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.321703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de84874fc8942a1897cbbc746dae0d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.392990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de84874fc8942a1897cbbc746dae0d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.409543 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de84874fc8942a1897cbbc746dae0d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.410272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de84874fc8942a1897cbbc746dae0d9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:22.416466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1351/2660] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:22 2022] DELETE /identity/v3/users/9de84874fc8942a1897cbbc746dae0d9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:22.870632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:22.872148 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:22.885507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847321f-5cb9-4283-8a73-02ca708ffae9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:22.904902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:22.943955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:22.944764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:22.944891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:22.945229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] PATH_INFO: `/v3/projects/301f803dab174acebb1a04572eda58f1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:22.946375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=301f803dab174acebb1a04572eda58f1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:22.948259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:23.085864 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301f803dab174acebb1a04572eda58f1', 'request_id': 'req-b38619c5-79d8-49ca-ba8d-4c762c2354ef'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.170388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301f803dab174acebb1a04572eda58f1', 'request_id': 'req-b38619c5-79d8-49ca-ba8d-4c762c2354ef'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.176686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301f803dab174acebb1a04572eda58f1', 'request_id': 'req-b38619c5-79d8-49ca-ba8d-4c762c2354ef'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.187965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] The token cache is being invalidate because project 301f803dab174acebb1a04572eda58f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:23.188252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.188888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.192367 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1310/2661] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:22 2022] DELETE /identity/v3/projects/301f803dab174acebb1a04572eda58f1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:23.194700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:23.196121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:23.209683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abcb35-f3a4-46ca-802a-8635afa0b655 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:23.265309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:23.265990 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:23.266264 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:23.266535 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] PATH_INFO: `/v3/users/a53010644ac7430ca5dcc550a127dbf9` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:23.267645 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53010644ac7430ca5dcc550a127dbf9)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:23.269597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:23.275221 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:23.337359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:23.338758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:23.351785 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38619c5-79d8-49ca-ba8d-4c762c2354ef admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:23.356450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:23.358867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:23.358867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:23.358867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] PATH_INFO: `/v3/users/9fcec78bea8a472cb2a0ee0e5e5b57b1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:23.358867 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcec78bea8a472cb2a0ee0e5e5b57b1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:23.360627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:23.466989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53010644ac7430ca5dcc550a127dbf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.474191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53010644ac7430ca5dcc550a127dbf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.511280 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcec78bea8a472cb2a0ee0e5e5b57b1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.511854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcec78bea8a472cb2a0ee0e5e5b57b1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.519205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcec78bea8a472cb2a0ee0e5e5b57b1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.532940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcec78bea8a472cb2a0ee0e5e5b57b1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.533685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-3438873d-7e32-4799-83ce-f45ec1f671dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcec78bea8a472cb2a0ee0e5e5b57b1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.562629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53010644ac7430ca5dcc550a127dbf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.575947 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53010644ac7430ca5dcc550a127dbf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.576590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53010644ac7430ca5dcc550a127dbf9'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:23.582501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1352/2662] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:23 2022] DELETE /identity/v3/users/a53010644ac7430ca5dcc550a127dbf9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:23.584118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:23.585960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:23.640968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1311/2663] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:23 2022] DELETE /identity/v3/users/9fcec78bea8a472cb2a0ee0e5e5b57b1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:23.645860 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:23.647048 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:23.647334 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:23.647531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f712-e368-43b3-ab0a-46fb83e88dd3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:23.669311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:23.670429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:23.691597 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:23.701212 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:23.701824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:23.702126 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:23.702399 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:23.704132 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:23.734963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1312/2664] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:23.745464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:23.757291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:23.757704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:23.771808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:23.773582 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:23.785393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1353/2665] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:23.833564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fff15-8bba-4d65-8f70-36e6a2492960 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:23.837308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d2857-8a8e-46fe-b967-072109e3e4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:23.837912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d2857-8a8e-46fe-b967-072109e3e4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:23.838228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d2857-8a8e-46fe-b967-072109e3e4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:23.838493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d2857-8a8e-46fe-b967-072109e3e4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:23.848014 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d2857-8a8e-46fe-b967-072109e3e4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:23.849648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d2857-8a8e-46fe-b967-072109e3e4d4 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:23.860233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1313/2666] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:45:24.014153 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.015815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:24.047749 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b368537-9307-42bb-9b97-330a210ccc20 service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.055239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.056120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.056462 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.057344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] PATH_INFO: `/v3/projects/b3e3d5a2ec1c49a093772a6c220ffd43` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.058554 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e3d5a2ec1c49a093772a6c220ffd43)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.060784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.178218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e3d5a2ec1c49a093772a6c220ffd43', 'request_id': 'req-4f819ef9-7b90-4cd9-926f-eadcedb767d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.185434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e3d5a2ec1c49a093772a6c220ffd43', 'request_id': 'req-4f819ef9-7b90-4cd9-926f-eadcedb767d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.191859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e3d5a2ec1c49a093772a6c220ffd43', 'request_id': 'req-4f819ef9-7b90-4cd9-926f-eadcedb767d8'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.279022 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] The token cache is being invalidate because project b3e3d5a2ec1c49a093772a6c220ffd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:24.279250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.279857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4f819ef9-7b90-4cd9-926f-eadcedb767d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.281378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1354/2667] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:24 2022] DELETE /identity/v3/projects/b3e3d5a2ec1c49a093772a6c220ffd43 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:24.287574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a278d-b187-43a6-8ef1-b20c863bf9fe None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.288092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a278d-b187-43a6-8ef1-b20c863bf9fe None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.288190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a278d-b187-43a6-8ef1-b20c863bf9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.307818 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8a8a278d-b187-43a6-8ef1-b20c863bf9fe None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:24.309013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8a8a278d-b187-43a6-8ef1-b20c863bf9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:24.368375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1314/2668] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:24.376807 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.377150 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.377434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.398358 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:24.399534 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:24.407334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1355/2669] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:24.419252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a278d-b187-43a6-8ef1-b20c863bf9fe None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.422335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a278d-b187-43a6-8ef1-b20c863bf9fe None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.422457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.423888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:24.427413 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.428105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.428391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.428723 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.429344 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:24.429651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.431268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.436312 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe22ac-9b5f-41de-a787-28138ef3c87a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.441494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.442133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.442519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.443509 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] PATH_INFO: `/v3/projects/8947d86f36d04455bc5101cb1c5db6c1` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.444740 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8947d86f36d04455bc5101cb1c5db6c1)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.445095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1315/2670] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:24.449451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.450163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.460164 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed3c1-206d-4056-a89d-7bdad8626e5b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.465209 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.465828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.466081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.466354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.466996 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.468861 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.594916 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1316/2671] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:24 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:24.598937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.606201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8947d86f36d04455bc5101cb1c5db6c1', 'request_id': 'req-aa3fe4c5-472a-4b20-ad64-0a059e289e56'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.612215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8947d86f36d04455bc5101cb1c5db6c1', 'request_id': 'req-aa3fe4c5-472a-4b20-ad64-0a059e289e56'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.620518 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8947d86f36d04455bc5101cb1c5db6c1', 'request_id': 'req-aa3fe4c5-472a-4b20-ad64-0a059e289e56'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.634965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:24.661776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41a6a-13e2-41dc-97d5-0b3645050865 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.666443 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.667039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.667318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.667588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.668206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.670146 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.711982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] The token cache is being invalidate because project 8947d86f36d04455bc5101cb1c5db6c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:24.712289 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.712917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.714557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1356/2672] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:24 2022] DELETE /identity/v3/projects/8947d86f36d04455bc5101cb1c5db6c1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:24.718398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.719692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:24.771207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:24.774428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1317/2673] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:24 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:24.778430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.780018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:24.789930 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fe4c5-472a-4b20-ad64-0a059e289e56 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.791793 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a2ca-8775-4a83-a420-90aeb2364d14 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.794564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.795193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.795753 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.796026 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] PATH_INFO: `/v3/users/cc194df7bb1d4aafa7316fd97a95f82a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.796662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.797216 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc194df7bb1d4aafa7316fd97a95f82a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.797319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.797538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.797803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.798455 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.799128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.800009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.810464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1318/2674] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:24.816276 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.826556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36366-77bc-4a00-9855-88d11e36937d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.831128 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.831748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.832031 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.832302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.832969 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.835009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.845803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1319/2675] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:24.850143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:24.860213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388843d2-8335-46e9-bb3e-f345b7fbd3e9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:24.866213 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce26fc-bbb8-450b-b69d-aea5b1b39c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:24.866863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce26fc-bbb8-450b-b69d-aea5b1b39c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.870928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce26fc-bbb8-450b-b69d-aea5b1b39c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.870928 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce26fc-bbb8-450b-b69d-aea5b1b39c6b admin admin] PATH_INFO: `/v3/projects/07f564d3553641e985a891d4b08cd978/users/379ae3ee66e94457964022b2db013efd/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.883047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce26fc-bbb8-450b-b69d-aea5b1b39c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f564d3553641e985a891d4b08cd978, user_id=379ae3ee66e94457964022b2db013efd, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:24.885726 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce26fc-bbb8-450b-b69d-aea5b1b39c6b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:24.947609 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1320/2676] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:24 2022] PUT /identity/v3/projects/07f564d3553641e985a891d4b08cd978/users/379ae3ee66e94457964022b2db013efd/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:24.960663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9350aa5-9b09-4e3f-aa79-698fa70edabc None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:24.960953 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9350aa5-9b09-4e3f-aa79-698fa70edabc None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:24.961259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9350aa5-9b09-4e3f-aa79-698fa70edabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:24.980724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc194df7bb1d4aafa7316fd97a95f82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.987683 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc194df7bb1d4aafa7316fd97a95f82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:24.989223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-a9350aa5-9b09-4e3f-aa79-698fa70edabc None None] MFA Rules not processed for user `379ae3ee66e94457964022b2db013efd`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:24.991147 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a9350aa5-9b09-4e3f-aa79-698fa70edabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:25.056195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1321/2677] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:25.060738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9350aa5-9b09-4e3f-aa79-698fa70edabc None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:25.062513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc194df7bb1d4aafa7316fd97a95f82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.075347 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc194df7bb1d4aafa7316fd97a95f82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.076094 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc194df7bb1d4aafa7316fd97a95f82a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.083850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1357/2678] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:24 2022] DELETE /identity/v3/users/cc194df7bb1d4aafa7316fd97a95f82a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:25.132289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9350aa5-9b09-4e3f-aa79-698fa70edabc None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:25.197095 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:25.197789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.198074 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.198340 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.199155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:25.200919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:25.271272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:25.301806 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1322/2679] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:25 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:25.306407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:25.308023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:25.322629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d85a2-393c-4d0a-9e82-2cebdc89da1f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:25.390165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:25.390797 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.391083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.391359 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.392685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:25.394644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:25.523576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1358/2680] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:25 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:25.527534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:25.537628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17dfcc-6367-479b-b7f7-fd680b75e27b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:25.542382 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:25.542964 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.543243 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.543508 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.544318 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:25.546678 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:25.559392 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:25.562223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:25.563534 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1323/2681] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:25.567924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:25.582408 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1786b2-415c-49d6-b071-586fa2614b24 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:25.586000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5268-724c-4a15-b9ad-0ad45795e21d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:25.596051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:25.596051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.596051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.596051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] PATH_INFO: `/v3/projects/a0edb9e60c0e4693917b2e1ee0ad1a8e/users/5fb62caba5e2434f846115595b594bd6/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.596592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:25.596592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.596592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.596592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] PATH_INFO: `/v3/projects/078eaf7cfc554cf5b177b8f296450dcb` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.596918 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078eaf7cfc554cf5b177b8f296450dcb)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:25.598651 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:25.609787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0edb9e60c0e4693917b2e1ee0ad1a8e, user_id=5fb62caba5e2434f846115595b594bd6, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:25.612924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:25.731559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1324/2682] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:25 2022] PUT /identity/v3/projects/a0edb9e60c0e4693917b2e1ee0ad1a8e/users/5fb62caba5e2434f846115595b594bd6/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:25.735429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:25.770355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078eaf7cfc554cf5b177b8f296450dcb', 'request_id': 'req-295a2c62-499b-4a19-85e7-33e2a3d1ff04'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.770811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:25.776802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078eaf7cfc554cf5b177b8f296450dcb', 'request_id': 'req-295a2c62-499b-4a19-85e7-33e2a3d1ff04'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.784734 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078eaf7cfc554cf5b177b8f296450dcb', 'request_id': 'req-295a2c62-499b-4a19-85e7-33e2a3d1ff04'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.805828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c8000-dc3d-4e33-830f-a13ff9e89c2d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:25.863114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:25.863114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.863390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.863682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.864305 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:25.866731 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:25.876660 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1325/2683] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:25.880652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:25.889931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2186cee-449b-40e0-a9d4-f43485daad89 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:25.894599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2605b05-f9f0-4f18-af75-abb2e89609de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:25.895109 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605b05-f9f0-4f18-af75-abb2e89609de admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.895387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605b05-f9f0-4f18-af75-abb2e89609de admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.895655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605b05-f9f0-4f18-af75-abb2e89609de admin admin] PATH_INFO: `/v3/projects/a0edb9e60c0e4693917b2e1ee0ad1a8e/users/5fb62caba5e2434f846115595b594bd6/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.897604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2605b05-f9f0-4f18-af75-abb2e89609de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0edb9e60c0e4693917b2e1ee0ad1a8e, user_id=5fb62caba5e2434f846115595b594bd6, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:25.900219 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2605b05-f9f0-4f18-af75-abb2e89609de admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:25.902567 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:25.907871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] The token cache is being invalidate because project 078eaf7cfc554cf5b177b8f296450dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:25.907871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.908232 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-295a2c62-499b-4a19-85e7-33e2a3d1ff04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:25.909893 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1359/2684] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:25 2022] DELETE /identity/v3/projects/078eaf7cfc554cf5b177b8f296450dcb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:25.910811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1326/2685] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:25 2022] PUT /identity/v3/projects/a0edb9e60c0e4693917b2e1ee0ad1a8e/users/5fb62caba5e2434f846115595b594bd6/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:25.915484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d5f1-6082-4ba1-b1db-0d53bb460484 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.915773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d5f1-6082-4ba1-b1db-0d53bb460484 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.916050 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d5f1-6082-4ba1-b1db-0d53bb460484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.921513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:25.921878 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:25.922173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:25.941522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9828d5f1-6082-4ba1-b1db-0d53bb460484 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:25.942718 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9828d5f1-6082-4ba1-b1db-0d53bb460484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:25.951105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] MFA Rules not processed for user `5fb62caba5e2434f846115595b594bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:25.952342 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:26.006163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1360/2686] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:26.015111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5309-2ad7-4041-81b2-2119f8e14d45 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.015397 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5309-2ad7-4041-81b2-2119f8e14d45 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.015668 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5309-2ad7-4041-81b2-2119f8e14d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.024866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1327/2687] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:26.036271 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c16e5309-2ad7-4041-81b2-2119f8e14d45 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:26.038076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c16e5309-2ad7-4041-81b2-2119f8e14d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:26.039286 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.040611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:26.046421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1361/2688] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:26.050857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5309-2ad7-4041-81b2-2119f8e14d45 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.060498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5309-2ad7-4041-81b2-2119f8e14d45 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.065340 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.065927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.066206 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.066476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.067146 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:26.067448 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.069211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.085107 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1362/2689] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:26.086376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.096123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c3e46-244e-4ee6-a9bb-e00e7063e300 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.096856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece57119-93f8-4789-8b41-7689921f4f8e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.101441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.106083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.106235 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.106353 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.106453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.106544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.106634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.106723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.106723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.106723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.113427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.114783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.124472 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1328/2690] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:26.215865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1363/2691] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:26 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:26.220079 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.231323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1639-ae7c-49ad-a4a6-1a3ec7c47a98 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.292914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.293551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.293829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.294097 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.294733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.297225 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.374306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1329/2692] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:26 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:26.382985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.393606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac589a-3750-4b81-8766-827d7c7443a9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.398922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.399556 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.399863 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.400136 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.400805 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.406319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.421272 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1364/2693] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:26.422459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.432475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82bf1-7837-473d-ba59-77f79d28efb1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.437067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601a4bd-4726-4313-b1c0-e1f02c9c4ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.437746 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a4bd-4726-4313-b1c0-e1f02c9c4ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.438017 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a4bd-4726-4313-b1c0-e1f02c9c4ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.438288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a4bd-4726-4313-b1c0-e1f02c9c4ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.438939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601a4bd-4726-4313-b1c0-e1f02c9c4ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.440572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601a4bd-4726-4313-b1c0-e1f02c9c4ed7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.446502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:26.451354 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1330/2694] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:26.455519 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.465646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000050-69fc-4372-bd5f-f57ff988951d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.470522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.471168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.471478 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.471789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] PATH_INFO: `/v3/projects/2366f9052b8e4fbdab0548365f7338b0/users/ae8e3261c3dd40d1832067eac325d2d5/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.486758 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2366f9052b8e4fbdab0548365f7338b0, user_id=ae8e3261c3dd40d1832067eac325d2d5, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.489453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.565249 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1365/2695] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:26 2022] PUT /identity/v3/projects/2366f9052b8e4fbdab0548365f7338b0/users/ae8e3261c3dd40d1832067eac325d2d5/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:26.579302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4f2b-dd8c-46dc-8e6b-dcff52347237 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.579605 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4f2b-dd8c-46dc-8e6b-dcff52347237 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.579866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4f2b-dd8c-46dc-8e6b-dcff52347237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.608499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-69df4f2b-dd8c-46dc-8e6b-dcff52347237 None None] MFA Rules not processed for user `ae8e3261c3dd40d1832067eac325d2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:26.609733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-69df4f2b-dd8c-46dc-8e6b-dcff52347237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:26.676244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1331/2696] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:26.681565 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.760259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4e52-4cce-461f-b24c-11935bc9b294 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.765371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.765976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.766546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.767451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.767451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.769472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:26.779920 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:26.919919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1366/2697] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:26 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:26.922693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4f2b-dd8c-46dc-8e6b-dcff52347237 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:26.933316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4f2b-dd8c-46dc-8e6b-dcff52347237 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:26.995408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:26.997984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:26.997984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:26.997984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:26.997984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:26.999115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.113527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1332/2698] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:26 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:27.117788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:27.127857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f3cd-3ac6-4daa-bd17-8ebdc2f1c858 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:27.134562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:27.134847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.135093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.141458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.141458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:27.141458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.148333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1367/2699] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:27.152570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:27.164154 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86011-0c5a-4ced-ba0b-c44ca2f4bbf9 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:27.168850 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:27.169556 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.169835 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.170294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] PATH_INFO: `/v3/projects/7b832a0e2cfa4c8a924a34437dc69f64/users/e186685d60344e48aea99de962666db5/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.192755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b832a0e2cfa4c8a924a34437dc69f64, user_id=e186685d60344e48aea99de962666db5, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:27.196291 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.290432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1333/2700] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:27 2022] PUT /identity/v3/projects/7b832a0e2cfa4c8a924a34437dc69f64/users/e186685d60344e48aea99de962666db5/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:27.294412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:27.304744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dcc0d-c103-43fc-a02a-2c24ec7c25e6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:27.364238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:27.364895 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.365903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.365903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.366387 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:27.367796 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.381652 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1368/2701] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:27.381808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:27.382234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:27.382725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:27.396422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9287-259d-4a6c-ab54-b9073640e856 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:27.400153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067733c-ff9f-4ac4-a930-0b545d1d2976 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:27.403187 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a2783-4433-4672-9ea9-b2861e965342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:27.404053 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2783-4433-4672-9ea9-b2861e965342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.404336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2783-4433-4672-9ea9-b2861e965342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.404711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2783-4433-4672-9ea9-b2861e965342 admin admin] PATH_INFO: `/v3/projects/7b832a0e2cfa4c8a924a34437dc69f64/users/e186685d60344e48aea99de962666db5/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.405121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:27.405762 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.406046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.406445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] PATH_INFO: `/v3/users/379ae3ee66e94457964022b2db013efd` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.406743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a2783-4433-4672-9ea9-b2861e965342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b832a0e2cfa4c8a924a34437dc69f64, user_id=e186685d60344e48aea99de962666db5, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:27.407639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379ae3ee66e94457964022b2db013efd)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:27.409570 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.409713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a2783-4433-4672-9ea9-b2861e965342 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.423317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1369/2702] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:27 2022] PUT /identity/v3/projects/7b832a0e2cfa4c8a924a34437dc69f64/users/e186685d60344e48aea99de962666db5/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:27.433646 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da046-0187-4951-9594-b4af9b88caf9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.433935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da046-0187-4951-9594-b4af9b88caf9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.434217 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da046-0187-4951-9594-b4af9b88caf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.463590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-235da046-0187-4951-9594-b4af9b88caf9 None None] MFA Rules not processed for user `e186685d60344e48aea99de962666db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:27.464801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-235da046-0187-4951-9594-b4af9b88caf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:27.534909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1370/2703] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:27.546586 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da046-0187-4951-9594-b4af9b88caf9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:27.597226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:27.602413 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da046-0187-4951-9594-b4af9b88caf9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:27.606424 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98a936-f843-4a0b-92ab-38029d3790dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:27.607055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98a936-f843-4a0b-92ab-38029d3790dd service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.607335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98a936-f843-4a0b-92ab-38029d3790dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.607606 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98a936-f843-4a0b-92ab-38029d3790dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.664800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98a936-f843-4a0b-92ab-38029d3790dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:27.666331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98a936-f843-4a0b-92ab-38029d3790dd service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.674335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379ae3ee66e94457964022b2db013efd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:27.674981 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379ae3ee66e94457964022b2db013efd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:27.675491 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1371/2704] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:45:27.677096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:27.683497 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379ae3ee66e94457964022b2db013efd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:27.695913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379ae3ee66e94457964022b2db013efd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:27.696618 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379ae3ee66e94457964022b2db013efd'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:27.813576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1334/2705] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:27 2022] DELETE /identity/v3/users/379ae3ee66e94457964022b2db013efd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:27.818147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.819337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.819337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.838097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:27.839301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:27.899372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1372/2706] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:27.909419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:27.910858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:27.967712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677609-cfbc-4b61-8021-b06c06fd3685 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:27.971299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:27.971902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:27.972179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:27.972452 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:27.981927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:27.983405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:27.993718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1335/2707] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:28.425063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:28.426612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:28.439822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090495b-4b05-4bc4-9bd0-4320c7e46201 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:28.446020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:28.446472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:28.446754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:28.447028 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] PATH_INFO: `/v3/projects/07f564d3553641e985a891d4b08cd978` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:28.448263 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f564d3553641e985a891d4b08cd978)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:28.457073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:28.533992 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:28.535403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:28.549338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29019930-3917-40fc-910e-7b52e7e768f5 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:28.553805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:28.554435 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:28.554711 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:28.554979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] PATH_INFO: `/v3/users/2c4504b2b5c1420eb00d17e9104c4e58` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:28.556207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4504b2b5c1420eb00d17e9104c4e58)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:28.558133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:28.597610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f564d3553641e985a891d4b08cd978', 'request_id': 'req-9d40eff8-835f-43d3-aa73-1ccfb0215c26'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.603932 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f564d3553641e985a891d4b08cd978', 'request_id': 'req-9d40eff8-835f-43d3-aa73-1ccfb0215c26'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.610175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f564d3553641e985a891d4b08cd978', 'request_id': 'req-9d40eff8-835f-43d3-aa73-1ccfb0215c26'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.693369 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] The token cache is being invalidate because project 07f564d3553641e985a891d4b08cd978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:28.694152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.694771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.696260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1373/2708] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:28 2022] DELETE /identity/v3/projects/07f564d3553641e985a891d4b08cd978 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:28.700163 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:28.701504 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:28.729194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:28.766865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40eff8-835f-43d3-aa73-1ccfb0215c26 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:28.771422 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:28.774378 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:28.774716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:28.774984 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] PATH_INFO: `/v3/users/5fb62caba5e2434f846115595b594bd6` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:28.775129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4504b2b5c1420eb00d17e9104c4e58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.775932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4504b2b5c1420eb00d17e9104c4e58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.776155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb62caba5e2434f846115595b594bd6)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:28.778116 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:28.784137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4504b2b5c1420eb00d17e9104c4e58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.796681 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4504b2b5c1420eb00d17e9104c4e58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.797399 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a675df82-ccc8-492e-8fda-a4c1aff28f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4504b2b5c1420eb00d17e9104c4e58'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.867734 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1336/2709] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:28 2022] DELETE /identity/v3/users/2c4504b2b5c1420eb00d17e9104c4e58 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:28.872170 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:28.872457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:28.872735 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:28.892062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:28.893288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:28.931152 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:28.951445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1337/2710] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:28.960802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb62caba5e2434f846115595b594bd6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:28.962089 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:28.963469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:28.967987 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb62caba5e2434f846115595b594bd6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:29.018627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5e7f4-2b6c-4356-8679-0b753435c547 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:29.022741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:29.023339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:29.023613 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:29.023891 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:29.032839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:29.035877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:29.043892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1338/2711] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:29.054802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb62caba5e2434f846115595b594bd6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:29.067609 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb62caba5e2434f846115595b594bd6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:29.068315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb62caba5e2434f846115595b594bd6'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:29.074969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1374/2712] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:28 2022] DELETE /identity/v3/users/5fb62caba5e2434f846115595b594bd6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:29.466155 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:29.467549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:29.524456 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4dc9e-e35e-4827-bb1e-cd81cac48010 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:29.573351 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:29.574028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:29.574220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:29.574488 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:29.576193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:29.630195 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:29.644321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:29.646184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:29.658441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1339/2713] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:29.996020 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:29.999838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:30.000680 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:30.001307 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:30.081084 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b60b4c-2264-4ac9-bcaf-2930286ba8b3 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:30.082007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b35ed-4d61-4c1f-87b3-7c08ce2112b6 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:30.085862 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:30.086589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.086741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:30.087009 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.087247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.087383 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] PATH_INFO: `/v3/projects/a0edb9e60c0e4693917b2e1ee0ad1a8e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.087520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.087787 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] PATH_INFO: `/v3/projects/a99a64a3166145899832a22548ff2a22` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.088834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0edb9e60c0e4693917b2e1ee0ad1a8e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:30.088984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99a64a3166145899832a22548ff2a22)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:30.090939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:30.091065 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:30.284956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99a64a3166145899832a22548ff2a22', 'request_id': 'req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.328117 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:30.330870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0edb9e60c0e4693917b2e1ee0ad1a8e', 'request_id': 'req-8b03bb9c-c858-4740-8f26-d86231a632bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.336328 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0edb9e60c0e4693917b2e1ee0ad1a8e', 'request_id': 'req-8b03bb9c-c858-4740-8f26-d86231a632bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.342567 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0edb9e60c0e4693917b2e1ee0ad1a8e', 'request_id': 'req-8b03bb9c-c858-4740-8f26-d86231a632bf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.370585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99a64a3166145899832a22548ff2a22', 'request_id': 'req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.376772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99a64a3166145899832a22548ff2a22', 'request_id': 'req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.388171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] The token cache is being invalidate because project a99a64a3166145899832a22548ff2a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:30.388462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.389126 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.390629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1340/2714] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:29 2022] DELETE /identity/v3/projects/a99a64a3166145899832a22548ff2a22 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:30.394356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:30.395671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:30.450170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] The token cache is being invalidate because project a0edb9e60c0e4693917b2e1ee0ad1a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:30.450580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.451250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-8b03bb9c-c858-4740-8f26-d86231a632bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.452803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1375/2715] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:29 2022] DELETE /identity/v3/projects/a0edb9e60c0e4693917b2e1ee0ad1a8e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:30.457388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f908a9-aa63-4642-832c-b20f9dbc5e5a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.466243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f908a9-aa63-4642-832c-b20f9dbc5e5a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.466243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f908a9-aa63-4642-832c-b20f9dbc5e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.466501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee13889-cd4c-4054-b6b0-fdfbec925b4c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:30.477726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a8f908a9-aa63-4642-832c-b20f9dbc5e5a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:30.478923 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a8f908a9-aa63-4642-832c-b20f9dbc5e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:30.487171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:30.517851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:30.518478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.518758 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.519030 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] PATH_INFO: `/v3/users/25cefc75376d4832a278ddeac8353a7f` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.520160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cefc75376d4832a278ddeac8353a7f)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:30.522783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:30.546409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1376/2716] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:30.554257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb704d3-4888-43b8-96c6-e407845157a6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.554563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb704d3-4888-43b8-96c6-e407845157a6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.554832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb704d3-4888-43b8-96c6-e407845157a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.574386 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-9bb704d3-4888-43b8-96c6-e407845157a6 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:30.575636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-9bb704d3-4888-43b8-96c6-e407845157a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:30.583613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1377/2717] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:30.588205 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb704d3-4888-43b8-96c6-e407845157a6 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:30.597087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb704d3-4888-43b8-96c6-e407845157a6 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:30.602128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:30.602697 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.602976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.603254 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.603919 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:30.604220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:30.605834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:30.617672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1378/2718] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:45:30.621929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:30.631460 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bcec3-eff7-457b-a01d-f8bd153d5032 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:30.636238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:30.636800 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.637099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.637416 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.638027 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:30.639907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:30.653058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cefc75376d4832a278ddeac8353a7f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.654007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cefc75376d4832a278ddeac8353a7f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.661141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cefc75376d4832a278ddeac8353a7f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.673718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cefc75376d4832a278ddeac8353a7f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.674385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cefc75376d4832a278ddeac8353a7f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:30.723381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1379/2719] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:30 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:30.728211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:30.729814 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:30.750478 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1341/2720] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:30 2022] DELETE /identity/v3/users/25cefc75376d4832a278ddeac8353a7f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:30.795349 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9cb4-6ab5-4926-a6f9-31cf3e97b23a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:30.839804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:30.865850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:30.869600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.869600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.869600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.869600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:30.869982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:30.964055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1380/2721] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:30 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:30.970133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:30.981010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2a5b-2e18-4342-9e94-8a41d066bf37 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:30.986019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:30.986713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:30.989968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:30.989968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:30.989968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:30.990638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.015228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1342/2722] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:31.016950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.029430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff0593-3420-4356-9c12-5e7a29a0c9f2 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.035850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff3739-6691-434a-b20f-44621c766434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.037771 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3739-6691-434a-b20f-44621c766434 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.038097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3739-6691-434a-b20f-44621c766434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.038373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3739-6691-434a-b20f-44621c766434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.039183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff3739-6691-434a-b20f-44621c766434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.040927 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff3739-6691-434a-b20f-44621c766434 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.054942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1381/2723] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:31.059016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.071010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66f9b-e359-4588-a52a-63fb19f84f25 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.076667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.077552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.077897 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.078590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] PATH_INFO: `/v3/projects/139de367dad04797bd8cf676ce1bcbc2/users/f06cf70cf2b148c599564d2714d4c98b/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.096390 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139de367dad04797bd8cf676ce1bcbc2, user_id=f06cf70cf2b148c599564d2714d4c98b, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.099186 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.171477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1343/2724] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:31 2022] PUT /identity/v3/projects/139de367dad04797bd8cf676ce1bcbc2/users/f06cf70cf2b148c599564d2714d4c98b/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:31.181750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9de47-5f63-4d41-bc2c-829091ebfe0a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.182038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9de47-5f63-4d41-bc2c-829091ebfe0a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.182314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9de47-5f63-4d41-bc2c-829091ebfe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.201450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.203247 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:31.216748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-ccf9de47-5f63-4d41-bc2c-829091ebfe0a None None] MFA Rules not processed for user `f06cf70cf2b148c599564d2714d4c98b`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:31.218373 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-ccf9de47-5f63-4d41-bc2c-829091ebfe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:31.275027 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5346ec1-43d9-40b3-81c9-515db97de5d0 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.279763 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.280385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.280661 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.280927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] PATH_INFO: `/v3/projects/017f029f84774cf491b8656337d8e771` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.282060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017f029f84774cf491b8656337d8e771)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.283938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.294044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1382/2725] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:31.298802 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9de47-5f63-4d41-bc2c-829091ebfe0a None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.305533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:31.310038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9de47-5f63-4d41-bc2c-829091ebfe0a None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.314703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.315305 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.315580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.315915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.317081 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.319208 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.404650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017f029f84774cf491b8656337d8e771', 'request_id': 'req-2abce33d-c175-483d-b294-3d52d26fd589'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.433774 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1383/2726] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:31 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:31.437634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.477248 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017f029f84774cf491b8656337d8e771', 'request_id': 'req-2abce33d-c175-483d-b294-3d52d26fd589'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.483573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017f029f84774cf491b8656337d8e771', 'request_id': 'req-2abce33d-c175-483d-b294-3d52d26fd589'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.496619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] The token cache is being invalidate because project 017f029f84774cf491b8656337d8e771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:31.496998 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.497749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.499268 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1344/2727] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:31 2022] DELETE /identity/v3/projects/017f029f84774cf491b8656337d8e771 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:31.500727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e5649-7f6b-4972-8bc6-d3b53284da06 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.503099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.504433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:31.505785 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.507082 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.507355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.507625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.508248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.510219 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.575124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abce33d-c175-483d-b294-3d52d26fd589 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.580046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.580674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.580952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.581252 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] PATH_INFO: `/v3/users/1f601660c3d2421bbc140af16a0e9f64` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.582510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f601660c3d2421bbc140af16a0e9f64)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.584541 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.625001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1384/2728] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:31 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:31.629877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.631639 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:31.643488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fc2c9-ab7b-4561-a62a-1e1501095576 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.648850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.649501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.649834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.650114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.650752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.652333 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.662999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1385/2729] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:31.674685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.680773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:31.684409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8476-3185-4eee-9301-aec95f869847 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.689118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.689743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.690023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.690299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] PATH_INFO: `/v3/projects/4383c38c8f52416bacd4779025dfc64a/users/06ab903fa09c411f8f3e1aa0bbd77b11/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.705234 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4383c38c8f52416bacd4779025dfc64a, user_id=06ab903fa09c411f8f3e1aa0bbd77b11, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.707843 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.807257 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f601660c3d2421bbc140af16a0e9f64'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.807906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f601660c3d2421bbc140af16a0e9f64'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.814917 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f601660c3d2421bbc140af16a0e9f64'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.822808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1386/2730] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:31 2022] PUT /identity/v3/projects/4383c38c8f52416bacd4779025dfc64a/users/06ab903fa09c411f8f3e1aa0bbd77b11/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:31.827992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.829248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:31.829536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f601660c3d2421bbc140af16a0e9f64'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.830233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f601660c3d2421bbc140af16a0e9f64'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:31.895085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f449a3-24db-42d4-b3be-c8ddcae62f20 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.901060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e1a16-6c09-4fa1-b442-20f022950cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.901722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e1a16-6c09-4fa1-b442-20f022950cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.901968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e1a16-6c09-4fa1-b442-20f022950cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.902239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e1a16-6c09-4fa1-b442-20f022950cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.902881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e1a16-6c09-4fa1-b442-20f022950cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:31.904492 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e1a16-6c09-4fa1-b442-20f022950cfb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:31.911308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1345/2731] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:31 2022] DELETE /identity/v3/users/1f601660c3d2421bbc140af16a0e9f64 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:31.919788 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1387/2732] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:45:31.922264 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:31.986830 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e17456-a960-4b6d-a6fc-4f21a700a4ad admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:31.991677 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:31.992331 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:31.992610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:31.992881 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] PATH_INFO: `/v3/projects/4383c38c8f52416bacd4779025dfc64a/users/06ab903fa09c411f8f3e1aa0bbd77b11/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:31.994855 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4383c38c8f52416bacd4779025dfc64a, user_id=06ab903fa09c411f8f3e1aa0bbd77b11, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:32.001958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:32.008788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1346/2733] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:31 2022] PUT /identity/v3/projects/4383c38c8f52416bacd4779025dfc64a/users/06ab903fa09c411f8f3e1aa0bbd77b11/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:32.019042 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:32.019552 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:32.019687 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:32.020451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:32.047821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] MFA Rules not processed for user `06ab903fa09c411f8f3e1aa0bbd77b11`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:32.049023 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:32.118331 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1388/2734] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:32.129684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:32.132211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:32.195446 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58bc2f-ea2d-4538-a373-059a74f618dd admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:32.200214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2432f51-b628-44b3-8f6a-22010087bf42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:32.200848 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432f51-b628-44b3-8f6a-22010087bf42 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:32.201156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432f51-b628-44b3-8f6a-22010087bf42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:32.201445 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432f51-b628-44b3-8f6a-22010087bf42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:32.203204 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b2432f51-b628-44b3-8f6a-22010087bf42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:32.265311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2432f51-b628-44b3-8f6a-22010087bf42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:32.266755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2432f51-b628-44b3-8f6a-22010087bf42 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:32.275951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1347/2735] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:45:32.372992 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:32.374661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:32.447303 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d28ad9-8248-4962-969e-5a43e9430a33 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:32.451940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:32.452563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:32.452841 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:32.453133 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] PATH_INFO: `/v3/projects/072f9267f94d4277ac84099cd37f5f2f` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:32.454239 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072f9267f94d4277ac84099cd37f5f2f)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:32.456112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:32.458698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:32.566055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072f9267f94d4277ac84099cd37f5f2f', 'request_id': 'req-66414a7c-bb13-4204-82d2-d3bb1f812e97'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:32.572088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072f9267f94d4277ac84099cd37f5f2f', 'request_id': 'req-66414a7c-bb13-4204-82d2-d3bb1f812e97'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:32.577985 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072f9267f94d4277ac84099cd37f5f2f', 'request_id': 'req-66414a7c-bb13-4204-82d2-d3bb1f812e97'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:32.642701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] The token cache is being invalidate because project 072f9267f94d4277ac84099cd37f5f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:32.642999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:32.643631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-66414a7c-bb13-4204-82d2-d3bb1f812e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:32.645123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1389/2736] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:32 2022] DELETE /identity/v3/projects/072f9267f94d4277ac84099cd37f5f2f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:32.650223 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e31ae-7bab-4b4d-b545-d700fd32e93e None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:32.650513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e31ae-7bab-4b4d-b545-d700fd32e93e None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:32.650790 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e31ae-7bab-4b4d-b545-d700fd32e93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:32.673929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-646e31ae-7bab-4b4d-b545-d700fd32e93e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:32.675192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-646e31ae-7bab-4b4d-b545-d700fd32e93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:32.744765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1348/2737] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:32.752713 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179c6f-4e6d-4422-92ec-fa3253a1a979 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:32.753227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179c6f-4e6d-4422-92ec-fa3253a1a979 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:32.758324 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179c6f-4e6d-4422-92ec-fa3253a1a979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:32.774419 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3d179c6f-4e6d-4422-92ec-fa3253a1a979 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:32.775610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3d179c6f-4e6d-4422-92ec-fa3253a1a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:32.783483 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1390/2738] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:32.788503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e31ae-7bab-4b4d-b545-d700fd32e93e None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:32.798316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e31ae-7bab-4b4d-b545-d700fd32e93e None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:32.802888 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:32.807385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:32.807385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:32.807385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:32.807385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:32.807385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:32.807385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:32.813432 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:32.818241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1349/2739] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:32.822588 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179c6f-4e6d-4422-92ec-fa3253a1a979 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:32.831957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179c6f-4e6d-4422-92ec-fa3253a1a979 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:32.839003 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:32.839610 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:32.839887 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:32.840157 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:32.840808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:32.842707 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:32.964297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1391/2740] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:32 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:32.967240 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:32.980913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bcb39-de4a-4e1c-b95d-7561f74ad720 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:33.053429 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:33.053654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:33.053907 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:33.054189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:33.054813 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:33.056714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:33.154459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1350/2741] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:32 2022] POST /identity/v3/users => generated 282 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:33.158803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:33.170240 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc075-b853-4122-808e-6ccc62cf5a26 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:33.175158 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:33.175783 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:33.176060 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:33.176334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:33.177080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:33.179134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:33.189546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1392/2742] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:33.194051 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:33.204388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef5cb-637b-4e81-ac3e-a75c36266090 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:33.209047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56355ee8-397a-4cb4-84ab-2f0204a827fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:33.210525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56355ee8-397a-4cb4-84ab-2f0204a827fa admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:33.210811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56355ee8-397a-4cb4-84ab-2f0204a827fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:33.211098 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56355ee8-397a-4cb4-84ab-2f0204a827fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:33.211770 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56355ee8-397a-4cb4-84ab-2f0204a827fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:33.213423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56355ee8-397a-4cb4-84ab-2f0204a827fa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:33.224949 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1351/2743] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:33.229097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:33.239355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383144d6-517a-499c-bba3-11c853ca068c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:33.243910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:33.244544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:33.244822 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:33.245149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] PATH_INFO: `/v3/projects/a7a637e2204042999592a48d621be968/users/02b65f12cf9b4be9bcefec19e1d56619/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:33.260298 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a637e2204042999592a48d621be968, user_id=02b65f12cf9b4be9bcefec19e1d56619, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:33.263124 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:33.330365 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1393/2744] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:33 2022] PUT /identity/v3/projects/a7a637e2204042999592a48d621be968/users/02b65f12cf9b4be9bcefec19e1d56619/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:33.342819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:33.343103 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:33.343389 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:33.375572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] MFA Rules not processed for user `02b65f12cf9b4be9bcefec19e1d56619`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:33.375572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:33.437491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1352/2745] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:33.449700 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:33.451441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:33.509744 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a8be6-316c-4952-86d3-a1ce68441cf9 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:33.513458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59191-c448-4f11-8fec-121cbc48daa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:33.514071 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59191-c448-4f11-8fec-121cbc48daa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:33.514348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59191-c448-4f11-8fec-121cbc48daa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:33.514619 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59191-c448-4f11-8fec-121cbc48daa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:33.523752 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59191-c448-4f11-8fec-121cbc48daa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:33.525204 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59191-c448-4f11-8fec-121cbc48daa8 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:33.534075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1394/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:34.124021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:34.125451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:34.194585 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42115d1c-4816-42fd-b802-83ae370349ed None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:34.200010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:34.200815 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:34.201136 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:34.201632 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] PATH_INFO: `/v3/users/ae8e3261c3dd40d1832067eac325d2d5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:34.202648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8e3261c3dd40d1832067eac325d2d5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:34.204610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:34.211844 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:34.413322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8e3261c3dd40d1832067eac325d2d5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:34.413910 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8e3261c3dd40d1832067eac325d2d5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:34.421013 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8e3261c3dd40d1832067eac325d2d5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:34.432973 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8e3261c3dd40d1832067eac325d2d5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:34.434064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8e3261c3dd40d1832067eac325d2d5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:34.518872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1353/2747] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:34 2022] DELETE /identity/v3/users/ae8e3261c3dd40d1832067eac325d2d5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:34.524297 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:34.524846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:34.524846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:34.543775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:34.546335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:34.570909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:34.603542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1395/2748] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:34.613185 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:34.614561 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:34.682116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957412b-db79-460d-8431-c9e81098ea67 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:34.686043 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:34.686652 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:34.686935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:34.687206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:34.696852 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:34.698462 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:34.708360 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1354/2749] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:45:35.144052 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:35.145525 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:35.157833 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30d184-1cec-453a-baaa-77e62a86ec84 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:35.163002 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:35.163620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:35.163903 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:35.164168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] PATH_INFO: `/v3/projects/2366f9052b8e4fbdab0548365f7338b0` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:35.165350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2366f9052b8e4fbdab0548365f7338b0)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:35.170452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:35.309200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2366f9052b8e4fbdab0548365f7338b0', 'request_id': 'req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.315080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2366f9052b8e4fbdab0548365f7338b0', 'request_id': 'req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.322267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2366f9052b8e4fbdab0548365f7338b0', 'request_id': 'req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.388070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] The token cache is being invalidate because project 2366f9052b8e4fbdab0548365f7338b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:35.388363 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.388971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.390658 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1396/2750] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:35 2022] DELETE /identity/v3/projects/2366f9052b8e4fbdab0548365f7338b0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:35.394845 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:35.405256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b07ab-1b3a-4150-af15-f295e95bd0a4 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:35.465080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:35.469634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:35.469634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:35.469634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] PATH_INFO: `/v3/users/e186685d60344e48aea99de962666db5` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:35.469634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e186685d60344e48aea99de962666db5)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:35.469634 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:35.639623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:35.653504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e186685d60344e48aea99de962666db5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.654270 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e186685d60344e48aea99de962666db5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.661427 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e186685d60344e48aea99de962666db5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.675066 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e186685d60344e48aea99de962666db5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.675794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-41015ffa-1a2b-403e-8dbd-543c533fab10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e186685d60344e48aea99de962666db5'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:35.753779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1355/2751] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:35 2022] DELETE /identity/v3/users/e186685d60344e48aea99de962666db5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:36.200190 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:36.202294 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:36.216711 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00100-38e8-43f8-b1fe-bf6fbdc66e05 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:36.275598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:36.276231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:36.276508 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:36.276779 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] PATH_INFO: `/v3/projects/7b832a0e2cfa4c8a924a34437dc69f64` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:36.278139 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b832a0e2cfa4c8a924a34437dc69f64)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:36.283316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:36.416917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b832a0e2cfa4c8a924a34437dc69f64', 'request_id': 'req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:36.423165 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b832a0e2cfa4c8a924a34437dc69f64', 'request_id': 'req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:36.424631 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:36.432114 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b832a0e2cfa4c8a924a34437dc69f64', 'request_id': 'req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:36.535585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] The token cache is being invalidate because project 7b832a0e2cfa4c8a924a34437dc69f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:36.535878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:36.536498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1bebee4d-f8f4-4db9-8edc-e1a68dd2ce7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:36.538112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1397/2752] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:36 2022] DELETE /identity/v3/projects/7b832a0e2cfa4c8a924a34437dc69f64 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:36.543179 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696a18-7905-414c-9e9b-41e397971493 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:36.543656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696a18-7905-414c-9e9b-41e397971493 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:36.543968 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696a18-7905-414c-9e9b-41e397971493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:36.567118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-37696a18-7905-414c-9e9b-41e397971493 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:36.569698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-37696a18-7905-414c-9e9b-41e397971493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:36.633091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1356/2753] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:36.641757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f442d-8a8e-4223-bfae-913e3eea7368 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:36.642059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f442d-8a8e-4223-bfae-913e3eea7368 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:36.642329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f442d-8a8e-4223-bfae-913e3eea7368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:36.661736 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-c76f442d-8a8e-4223-bfae-913e3eea7368 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:36.662902 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c76f442d-8a8e-4223-bfae-913e3eea7368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:36.671010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1398/2754] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:36.675192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37696a18-7905-414c-9e9b-41e397971493 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:36.685419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37696a18-7905-414c-9e9b-41e397971493 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:36.689902 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:36.690492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:36.690768 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:36.691036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:36.691676 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:36.691978 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:36.694328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:36.706010 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1357/2755] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:36.710497 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f442d-8a8e-4223-bfae-913e3eea7368 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:36.719604 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f442d-8a8e-4223-bfae-913e3eea7368 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:36.724247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:36.725087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:36.725435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:36.725705 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:36.726437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:36.728473 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:36.815097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1399/2756] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:36 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:36.820289 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:36.830451 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be2682-5fda-4e25-9f96-2a7f52da0952 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:36.886418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:36.887929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:36.887929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:36.887929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:36.888317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:36.890139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:36.976391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1358/2757] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:36 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:36.980634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:36.991350 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbc27-7916-4180-aa62-562bd490e12c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:36.995857 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:36.996442 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:36.996719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:36.996988 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:36.997677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:36.999244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:37.009787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1400/2758] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:37.013765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:37.024208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ea23c-8b30-487b-b4e1-38583ae3bb40 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:37.028794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e355c-6887-4b27-8ca8-ce2c1e3e903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:37.029836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e355c-6887-4b27-8ca8-ce2c1e3e903d admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:37.029836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e355c-6887-4b27-8ca8-ce2c1e3e903d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:37.030054 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e355c-6887-4b27-8ca8-ce2c1e3e903d admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:37.030690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e355c-6887-4b27-8ca8-ce2c1e3e903d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:37.032254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e355c-6887-4b27-8ca8-ce2c1e3e903d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:37.043571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1359/2759] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:37.048069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:37.058909 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85914c7-bd1c-49ef-9831-ac9e56b88a43 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:37.063506 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:37.064175 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:37.064454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:37.064729 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] PATH_INFO: `/v3/projects/5b0347d24bc1483494c058ad2c65fae8/users/f7c1893b6cc94e37bb06cde6d22b21a1/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:37.079463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0347d24bc1483494c058ad2c65fae8, user_id=f7c1893b6cc94e37bb06cde6d22b21a1, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:37.082156 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:37.176981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1401/2760] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:37 2022] PUT /identity/v3/projects/5b0347d24bc1483494c058ad2c65fae8/users/f7c1893b6cc94e37bb06cde6d22b21a1/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:37.182991 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:37.183278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:37.183552 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:37.202504 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:37.203697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:37.212077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:37.262491 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1360/2761] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:37.272648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:37.274471 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:37.331501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431738d4-656b-4f63-810b-2cdfc3554676 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:37.335891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d5b48-ddf9-433e-a178-8e19b50966c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:37.336494 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b48-ddf9-433e-a178-8e19b50966c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:37.336782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b48-ddf9-433e-a178-8e19b50966c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:37.337073 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b48-ddf9-433e-a178-8e19b50966c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:37.345976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d5b48-ddf9-433e-a178-8e19b50966c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:37.351661 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d5b48-ddf9-433e-a178-8e19b50966c9 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:37.357546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1402/2762] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:37.594795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:37.596350 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:37.653976 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2dd8-c102-4c6c-a645-8a39e30fa267 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:37.657745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:37.658215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:37.658779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:37.658779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:37.660481 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:37.731794 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:37.733277 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:37.743279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1361/2763] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:38.754599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f16b-ba3b-42ee-8592-921f0899a366 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:38.755070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f16b-ba3b-42ee-8592-921f0899a366 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:38.755183 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f16b-ba3b-42ee-8592-921f0899a366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:38.785199 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-b523f16b-ba3b-42ee-8592-921f0899a366 None None] MFA Rules not processed for user `f7c1893b6cc94e37bb06cde6d22b21a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:38.786409 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b523f16b-ba3b-42ee-8592-921f0899a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:38.862942 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1403/2764] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:38.868045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:38.878525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923986-8a3d-4f34-ab0b-c85b43c7ad0c service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:38.883686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:38.884279 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:38.884558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:38.884877 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:38.889466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:38.889466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:38.971890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1362/2765] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:38 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:38.976394 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523f16b-ba3b-42ee-8592-921f0899a366 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:38.987215 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523f16b-ba3b-42ee-8592-921f0899a366 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:38.996522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:39.043466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:39.044237 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:39.044546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:39.044823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:39.045487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:39.047777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:39.308465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1404/2766] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:38 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:39.312486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:39.323685 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da062e1-9b7b-4fea-ab6c-1feba948cfe8 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:39.328565 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:39.329208 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:39.329492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:39.329767 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:39.330482 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:39.332077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:39.343545 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1363/2767] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:39.347891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:39.358636 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393fc35-8337-4df9-8dc8-c1c72f82836e admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:39.363576 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:39.364260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:39.364515 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:39.364792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] PATH_INFO: `/v3/projects/0ea7a45c095a4d0faad53b55138c75ed/users/8474527a04db4cd590c0f2020ae42292/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:39.380957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea7a45c095a4d0faad53b55138c75ed, user_id=8474527a04db4cd590c0f2020ae42292, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:39.383777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:39.488809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1405/2768] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:39 2022] PUT /identity/v3/projects/0ea7a45c095a4d0faad53b55138c75ed/users/8474527a04db4cd590c0f2020ae42292/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:39.494036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:39.504033 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfea76-04de-47b5-93ce-54e2b7f06bf1 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:39.541403 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:39.570538 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11b7a0-8c95-487f-ba50-d62a71012091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:39.571177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11b7a0-8c95-487f-ba50-d62a71012091 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:39.571459 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11b7a0-8c95-487f-ba50-d62a71012091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:39.571729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11b7a0-8c95-487f-ba50-d62a71012091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:39.572368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11b7a0-8c95-487f-ba50-d62a71012091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:39.574019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11b7a0-8c95-487f-ba50-d62a71012091 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:39.583771 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1364/2769] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:39.588741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:39.600499 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce220ae-2af4-4a0f-bef9-25dada63bc25 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:39.606859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4519b9-ffcb-46e3-95c8-020612385107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:39.607521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4519b9-ffcb-46e3-95c8-020612385107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:39.616040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4519b9-ffcb-46e3-95c8-020612385107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:39.616040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4519b9-ffcb-46e3-95c8-020612385107 admin admin] PATH_INFO: `/v3/projects/0ea7a45c095a4d0faad53b55138c75ed/users/8474527a04db4cd590c0f2020ae42292/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:39.616040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4519b9-ffcb-46e3-95c8-020612385107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea7a45c095a4d0faad53b55138c75ed, user_id=8474527a04db4cd590c0f2020ae42292, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:39.616040 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4519b9-ffcb-46e3-95c8-020612385107 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:39.626121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1406/2770] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:39 2022] PUT /identity/v3/projects/0ea7a45c095a4d0faad53b55138c75ed/users/8474527a04db4cd590c0f2020ae42292/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:45:41.310582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:41.310582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:41.310582 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:41.342150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] MFA Rules not processed for user `8474527a04db4cd590c0f2020ae42292`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:41.343384 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:41.421756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1365/2771] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:41.493684 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:41.494231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:41.494231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:41.514160 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] MFA Rules not processed for user `f7c1893b6cc94e37bb06cde6d22b21a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:41.515445 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:41.570745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1407/2772] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:41.584019 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:41.586036 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:41.660150 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0f6c-b02c-4e63-ba99-976079c8799d None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:41.665789 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315580e7-f28c-4f96-9929-2ccd0b3ac2fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:41.666391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315580e7-f28c-4f96-9929-2ccd0b3ac2fa service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:41.666671 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315580e7-f28c-4f96-9929-2ccd0b3ac2fa service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:41.666941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315580e7-f28c-4f96-9929-2ccd0b3ac2fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:41.675385 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315580e7-f28c-4f96-9929-2ccd0b3ac2fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:41.677076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315580e7-f28c-4f96-9929-2ccd0b3ac2fa service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:41.686261 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1366/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:43.681891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:43.681891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:43.747230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc5276-9bad-4ab2-b913-d6d1ee9399b1 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:43.751662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:43.752283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:43.752557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:43.752824 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] PATH_INFO: `/v3/users/f06cf70cf2b148c599564d2714d4c98b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:43.753986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06cf70cf2b148c599564d2714d4c98b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:43.755870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:43.768719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:43.960906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06cf70cf2b148c599564d2714d4c98b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:43.969283 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06cf70cf2b148c599564d2714d4c98b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.056437 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06cf70cf2b148c599564d2714d4c98b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.081612 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06cf70cf2b148c599564d2714d4c98b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.082368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06cf70cf2b148c599564d2714d4c98b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.096546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1408/2774] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:43 2022] DELETE /identity/v3/users/f06cf70cf2b148c599564d2714d4c98b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:44.101549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:44.101549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:44.101549 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:44.116189 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:44.117906 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:44.151296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:44.180042 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1367/2775] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:44.191443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:44.196986 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:44.253170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa70085-227c-4156-9054-2b85854bfa9c admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:44.256757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:44.257418 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:44.257692 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:44.257960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:44.266872 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:44.268337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:44.278319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1409/2776] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:44.704590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:44.704590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:44.723109 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb54099-e9c4-49b2-bc8d-ccc2abb663eb None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:44.729533 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:44.740756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:44.740756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:44.740756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] PATH_INFO: `/v3/projects/139de367dad04797bd8cf676ce1bcbc2` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:44.740756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139de367dad04797bd8cf676ce1bcbc2)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:44.740756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:44.864879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139de367dad04797bd8cf676ce1bcbc2', 'request_id': 'req-39f48c15-6bf9-4a71-a326-dc4486afb779'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.918886 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139de367dad04797bd8cf676ce1bcbc2', 'request_id': 'req-39f48c15-6bf9-4a71-a326-dc4486afb779'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.925655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139de367dad04797bd8cf676ce1bcbc2', 'request_id': 'req-39f48c15-6bf9-4a71-a326-dc4486afb779'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.937895 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] The token cache is being invalidate because project 139de367dad04797bd8cf676ce1bcbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:44.938181 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.938836 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:44.943824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1368/2777] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:44 2022] DELETE /identity/v3/projects/139de367dad04797bd8cf676ce1bcbc2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:44.945398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:44.955149 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee27b-662f-4df1-8aee-698fe4748c2c service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:45.032228 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:45.033111 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:45.033503 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:45.033831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] PATH_INFO: `/v3/users/06ab903fa09c411f8f3e1aa0bbd77b11` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:45.034953 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ab903fa09c411f8f3e1aa0bbd77b11)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:45.036874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:45.296520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:45.306388 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ab903fa09c411f8f3e1aa0bbd77b11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:45.313540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ab903fa09c411f8f3e1aa0bbd77b11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:45.433398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ab903fa09c411f8f3e1aa0bbd77b11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:45.446769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ab903fa09c411f8f3e1aa0bbd77b11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:45.447414 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-7affdeba-5ab0-405c-a7e1-8decf0badf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ab903fa09c411f8f3e1aa0bbd77b11'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:45.453250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1410/2778] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:44 2022] DELETE /identity/v3/users/06ab903fa09c411f8f3e1aa0bbd77b11 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:46.129381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:46.129381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:46.139006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48c15-6bf9-4a71-a326-dc4486afb779 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:46.232236 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:46.232865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:46.233180 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:46.233453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] PATH_INFO: `/v3/projects/4383c38c8f52416bacd4779025dfc64a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:46.234553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4383c38c8f52416bacd4779025dfc64a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:46.236437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:46.365772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4383c38c8f52416bacd4779025dfc64a', 'request_id': 'req-18f20623-e970-4f06-8574-c9c28ff70ae6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:46.454316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4383c38c8f52416bacd4779025dfc64a', 'request_id': 'req-18f20623-e970-4f06-8574-c9c28ff70ae6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:46.459863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:46.462963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4383c38c8f52416bacd4779025dfc64a', 'request_id': 'req-18f20623-e970-4f06-8574-c9c28ff70ae6'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:46.474721 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] The token cache is being invalidate because project 4383c38c8f52416bacd4779025dfc64a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:46.475016 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:46.475673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-18f20623-e970-4f06-8574-c9c28ff70ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:46.478330 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1369/2779] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:46 2022] DELETE /identity/v3/projects/4383c38c8f52416bacd4779025dfc64a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:46.484453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2771d1-394d-4389-998b-94a8877ad926 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:46.484960 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2771d1-394d-4389-998b-94a8877ad926 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:46.485077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2771d1-394d-4389-998b-94a8877ad926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:46.504859 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bb2771d1-394d-4389-998b-94a8877ad926 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:46.506106 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bb2771d1-394d-4389-998b-94a8877ad926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:46.571076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1411/2780] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:45:46.579551 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dfd94-1980-4dac-97b5-c6e883b9b46f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:46.579838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dfd94-1980-4dac-97b5-c6e883b9b46f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:46.580110 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dfd94-1980-4dac-97b5-c6e883b9b46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:46.600499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-e46dfd94-1980-4dac-97b5-c6e883b9b46f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:46.602310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-e46dfd94-1980-4dac-97b5-c6e883b9b46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:46.610387 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1370/2781] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:46.614806 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2771d1-394d-4389-998b-94a8877ad926 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:46.624809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2771d1-394d-4389-998b-94a8877ad926 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:46.629463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:46.630068 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:46.630348 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:46.630620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:46.631269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:46.631601 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:46.633760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:46.645430 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1412/2782] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:46.658310 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dfd94-1980-4dac-97b5-c6e883b9b46f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:46.667705 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dfd94-1980-4dac-97b5-c6e883b9b46f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:46.672502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:46.673145 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:46.673416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:46.673680 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:46.674295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:46.676173 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:46.781716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1371/2783] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:46 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:46.786184 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:46.800118 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27098a79-96fc-4c9f-b18b-88ce78a1209b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:46.875750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:46.876451 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:46.876730 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:46.877001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:46.877894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:46.879823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:47.009075 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1413/2784] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:46 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:45:47.013112 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:47.023994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba232e5-6cca-4d27-9c53-e0e7dec3bfde admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:47.028803 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:47.029507 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:47.029947 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:47.030190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:47.030887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:47.032558 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:47.043750 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1372/2785] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:47.047980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:47.060530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6800303-93d2-4e09-abcf-db84ff0caefc admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:47.065391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258807-b8f1-49ca-b622-67589857faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:47.065997 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258807-b8f1-49ca-b622-67589857faa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:47.066274 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258807-b8f1-49ca-b622-67589857faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:47.066547 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258807-b8f1-49ca-b622-67589857faa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:47.067176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f258807-b8f1-49ca-b622-67589857faa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:47.068754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f258807-b8f1-49ca-b622-67589857faa4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:47.080010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1414/2786] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:47.084297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:47.096101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248515ec-10d4-4eb7-978d-195b9291cdaa admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:47.101628 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:47.102513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:47.102858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:47.103193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] PATH_INFO: `/v3/projects/a572d5d829b648e89fb29ae9808a43e3/users/59a47809075b4cfa87f28c0a438b227b/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:47.118621 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a572d5d829b648e89fb29ae9808a43e3, user_id=59a47809075b4cfa87f28c0a438b227b, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:47.121480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:47.198511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1373/2787] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:47 2022] PUT /identity/v3/projects/a572d5d829b648e89fb29ae9808a43e3/users/59a47809075b4cfa87f28c0a438b227b/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:47.210001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85dabc-a261-4390-b3ec-3c37d76d931f None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:47.210775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85dabc-a261-4390-b3ec-3c37d76d931f None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:47.211049 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85dabc-a261-4390-b3ec-3c37d76d931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:47.246925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-0a85dabc-a261-4390-b3ec-3c37d76d931f None None] MFA Rules not processed for user `59a47809075b4cfa87f28c0a438b227b`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:47.248145 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-0a85dabc-a261-4390-b3ec-3c37d76d931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:47.253510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:47.318502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1415/2788] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:47.331522 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:47.333375 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:47.394356 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436d92f-1445-43b4-bba1-1d65a9347f6b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:47.398177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce163a43-9268-4c0c-967f-4728631da629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:47.398776 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163a43-9268-4c0c-967f-4728631da629 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:47.399053 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163a43-9268-4c0c-967f-4728631da629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:47.399319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163a43-9268-4c0c-967f-4728631da629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:47.409708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce163a43-9268-4c0c-967f-4728631da629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:47.411228 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce163a43-9268-4c0c-967f-4728631da629 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:47.422220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1374/2789] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:47.449819 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85dabc-a261-4390-b3ec-3c37d76d931f None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:47.520479 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85dabc-a261-4390-b3ec-3c37d76d931f None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:47.526569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:47.527246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:47.527530 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:47.527832 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] PATH_INFO: `/v3/users/59a47809075b4cfa87f28c0a438b227b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:47.529017 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a47809075b4cfa87f28c0a438b227b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:47.530974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:47.812411 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a47809075b4cfa87f28c0a438b227b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:47.819247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a47809075b4cfa87f28c0a438b227b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:47.914001 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a47809075b4cfa87f28c0a438b227b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:47.927076 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a47809075b4cfa87f28c0a438b227b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:47.927723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a47809075b4cfa87f28c0a438b227b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:47.933769 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1416/2790] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:45:47 2022] DELETE /identity/v3/users/59a47809075b4cfa87f28c0a438b227b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:47.938227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:47.938515 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:47.938795 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:47.963226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:47.964441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:48.023524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1375/2791] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:48.033257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:48.034674 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:48.066108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:48.093966 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f49a7-526b-434c-8804-3e1c268187f8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:48.097750 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128ffda-6fd9-4f27-a9ca-450b1c42e141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:48.098351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128ffda-6fd9-4f27-a9ca-450b1c42e141 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:48.098638 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128ffda-6fd9-4f27-a9ca-450b1c42e141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:48.098910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128ffda-6fd9-4f27-a9ca-450b1c42e141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:48.108368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128ffda-6fd9-4f27-a9ca-450b1c42e141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:48.109823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128ffda-6fd9-4f27-a9ca-450b1c42e141 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:48.119300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1417/2792] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:48.564088 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:48.567408 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:48.588765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36c34-8858-4f6b-9236-8100b4b9aee9 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:48.593883 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:48.594519 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:48.594798 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:48.595918 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] PATH_INFO: `/v3/projects/a572d5d829b648e89fb29ae9808a43e3` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:48.596564 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a572d5d829b648e89fb29ae9808a43e3)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:48.598540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:48.705068 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:48.718178 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a572d5d829b648e89fb29ae9808a43e3', 'request_id': 'req-24115dc4-10cd-4aa9-b073-25ba343d671f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:48.815854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a572d5d829b648e89fb29ae9808a43e3', 'request_id': 'req-24115dc4-10cd-4aa9-b073-25ba343d671f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:48.822775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a572d5d829b648e89fb29ae9808a43e3', 'request_id': 'req-24115dc4-10cd-4aa9-b073-25ba343d671f'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:48.834052 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] The token cache is being invalidate because project a572d5d829b648e89fb29ae9808a43e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:45:48.834335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:48.834979 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-24115dc4-10cd-4aa9-b073-25ba343d671f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:45:48.836553 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1376/2793] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:45:48 2022] DELETE /identity/v3/projects/a572d5d829b648e89fb29ae9808a43e3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:48.842982 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3eefe-3aab-4b6c-99c7-e8364219e996 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:48.844080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3eefe-3aab-4b6c-99c7-e8364219e996 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:48.844371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3eefe-3aab-4b6c-99c7-e8364219e996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:48.865055 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-e3d3eefe-3aab-4b6c-99c7-e8364219e996 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:48.866306 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-e3d3eefe-3aab-4b6c-99c7-e8364219e996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:48.927300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1418/2794] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:48.936588 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4dee-5547-45e4-8ae7-3f38590f6f82 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:48.936876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4dee-5547-45e4-8ae7-3f38590f6f82 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:48.939912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4dee-5547-45e4-8ae7-3f38590f6f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:48.958229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-897d4dee-5547-45e4-8ae7-3f38590f6f82 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:48.959418 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-897d4dee-5547-45e4-8ae7-3f38590f6f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:48.968577 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1377/2795] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:48.971659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3eefe-3aab-4b6c-99c7-e8364219e996 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:48.982207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3eefe-3aab-4b6c-99c7-e8364219e996 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:48.986935 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:48.987531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:48.987810 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:48.988079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:48.988721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:45:48.989016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:48.990643 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:49.003105 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1419/2796] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:45:49.007423 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4dee-5547-45e4-8ae7-3f38590f6f82 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:49.016303 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4dee-5547-45e4-8ae7-3f38590f6f82 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:49.020847 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:49.021468 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:49.021743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:49.022011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:49.022654 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:49.024619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:49.125163 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1378/2797] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:45:49 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:49.129243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:49.138969 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a4d9c-4d7f-4eec-878d-d8ea8dfb7960 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:49.196728 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:49.197382 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:49.197663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:49.197940 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:49.198585 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:49.200540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:49.332301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1420/2798] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:45:49 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:45:49.334115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:49.346296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525f23-4290-4d44-ae60-032d88d0018e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:49.353317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:49.353929 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:49.354799 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:49.355072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:49.355717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:49.361474 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:49.368804 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1379/2799] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:49.372840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:49.388688 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354955-8e0a-4ae8-bdeb-bea24ff000e7 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:49.393579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4934a-a88b-40e8-8f83-4ba8e436cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:49.394244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4934a-a88b-40e8-8f83-4ba8e436cd44 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:49.394634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4934a-a88b-40e8-8f83-4ba8e436cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:49.394856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4934a-a88b-40e8-8f83-4ba8e436cd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:49.395622 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4934a-a88b-40e8-8f83-4ba8e436cd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:49.397441 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4934a-a88b-40e8-8f83-4ba8e436cd44 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:49.409521 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1421/2800] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:45:49.414527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:49.425024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205cd9-f5d5-486d-b88c-3a16e613f3f5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:49.430231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:49.430898 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:49.431194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:49.431439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] PATH_INFO: `/v3/projects/1e172de735f946e0a70579256283b7fe/users/c25337731ebe43c99d17fa7df671be7e/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:49.446543 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e172de735f946e0a70579256283b7fe, user_id=c25337731ebe43c99d17fa7df671be7e, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:49.449241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:49.529311 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1380/2801] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:45:49 2022] PUT /identity/v3/projects/1e172de735f946e0a70579256283b7fe/users/c25337731ebe43c99d17fa7df671be7e/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:45:49.599620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07b4de-29a2-4dd7-80eb-c3692b0e7bdb None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:49.599910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07b4de-29a2-4dd7-80eb-c3692b0e7bdb None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:49.600188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07b4de-29a2-4dd7-80eb-c3692b0e7bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:49.637231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-bd07b4de-29a2-4dd7-80eb-c3692b0e7bdb None None] MFA Rules not processed for user `c25337731ebe43c99d17fa7df671be7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:49.637231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-bd07b4de-29a2-4dd7-80eb-c3692b0e7bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:49.654334 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:49.692803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1422/2802] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:49.704760 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:49.706638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:49.762839 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df14ffe-089d-46c0-89c2-810f0e80608e admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:49.766450 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:49.767046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:49.767325 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:49.767595 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:49.776411 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:49.777866 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:49.787000 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1381/2803] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:45:51.626200 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:51.626685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:51.626685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:51.645242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] MFA Rules not processed for user `c25337731ebe43c99d17fa7df671be7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:45:51.646444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:51.653890 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1423/2804] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:45:58.174704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:45:58.184135 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8452be-87e1-4a25-8380-5b15515ec449 service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:45:58.187924 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:45:58.188590 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:45:58.188937 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:45:58.189475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:45:58.191293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:45:58.259824 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:45:58.274133 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:45:58.276448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:45:58.287168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1382/2805] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:45:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:01.640569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=19 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:01.986786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:01.988341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:02.086513 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4023a-2471-43bc-9b0d-f6ce5106c396 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:02.092858 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1c71-9c77-44d3-abe4-7056df8e668f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:02.093542 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1c71-9c77-44d3-abe4-7056df8e668f service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:02.093813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1c71-9c77-44d3-abe4-7056df8e668f service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:02.094083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1c71-9c77-44d3-abe4-7056df8e668f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:02.096014 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c00d1c71-9c77-44d3-abe4-7056df8e668f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:02.108302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1c71-9c77-44d3-abe4-7056df8e668f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:02.109925 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1c71-9c77-44d3-abe4-7056df8e668f service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:02.120372 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1424/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:08.347377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:10.276656 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:10.278490 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:10.351638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14255a-4895-47d1-b1ee-ea38363cec0a service cinder] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:10.357576 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:10.358740 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:10.359295 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:10.359749 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] PATH_INFO: `/v3/users/02b65f12cf9b4be9bcefec19e1d56619` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:10.361700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b65f12cf9b4be9bcefec19e1d56619)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:10.365188 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:10.583788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b65f12cf9b4be9bcefec19e1d56619'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:10.585578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b65f12cf9b4be9bcefec19e1d56619'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:10.596783 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b65f12cf9b4be9bcefec19e1d56619'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:10.617448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b65f12cf9b4be9bcefec19e1d56619'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:10.619642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b65f12cf9b4be9bcefec19e1d56619'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:10.705407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1383/2807] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:46:10 2022] DELETE /identity/v3/users/02b65f12cf9b4be9bcefec19e1d56619 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:10.705510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:10.705510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:10.705510 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:10.732850 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:10.736288 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:10.815279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1425/2808] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:10.825104 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:10.826505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:10.890081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c489e-4215-4530-9bef-3037f97cc04d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:10.895114 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15925efc-9bbb-47e2-a6cf-a6ef5901e0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:10.896058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15925efc-9bbb-47e2-a6cf-a6ef5901e0da service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:10.896343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15925efc-9bbb-47e2-a6cf-a6ef5901e0da service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:10.896624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15925efc-9bbb-47e2-a6cf-a6ef5901e0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:10.908525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15925efc-9bbb-47e2-a6cf-a6ef5901e0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:10.910162 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15925efc-9bbb-47e2-a6cf-a6ef5901e0da service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:10.921105 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1384/2809] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:11.372286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:11.374407 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:11.385754 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260928ae-4c98-4f28-a461-e20520f5a737 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:11.391370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:11.392070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:11.392296 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:11.392548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] PATH_INFO: `/v3/projects/a7a637e2204042999592a48d621be968` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:11.393764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a637e2204042999592a48d621be968)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:11.395613 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:11.525847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a637e2204042999592a48d621be968', 'request_id': 'req-82e018d3-7086-49bb-ad8d-5f15ec1482ca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:11.532933 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a637e2204042999592a48d621be968', 'request_id': 'req-82e018d3-7086-49bb-ad8d-5f15ec1482ca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:11.539178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a637e2204042999592a48d621be968', 'request_id': 'req-82e018d3-7086-49bb-ad8d-5f15ec1482ca'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:11.542355 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:11.695971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] The token cache is being invalidate because project a7a637e2204042999592a48d621be968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:46:11.696194 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:11.696803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-82e018d3-7086-49bb-ad8d-5f15ec1482ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:11.698351 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1426/2810] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:46:11 2022] DELETE /identity/v3/projects/a7a637e2204042999592a48d621be968 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:11.704118 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d454-2ea0-47a2-aacf-5de19b427696 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:11.704682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d454-2ea0-47a2-aacf-5de19b427696 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:11.704682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d454-2ea0-47a2-aacf-5de19b427696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:11.741078 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:11.746626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-b0b2d454-2ea0-47a2-aacf-5de19b427696 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:11.747826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-b0b2d454-2ea0-47a2-aacf-5de19b427696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:11.808012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1385/2811] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:46:11.816291 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427111-969a-4784-a98c-dcd92ca06f88 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:11.816838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427111-969a-4784-a98c-dcd92ca06f88 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:11.816838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427111-969a-4784-a98c-dcd92ca06f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:11.836828 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-08427111-969a-4784-a98c-dcd92ca06f88 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:11.838080 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-08427111-969a-4784-a98c-dcd92ca06f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:11.847041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1427/2812] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:11.851254 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d454-2ea0-47a2-aacf-5de19b427696 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:11.862130 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d454-2ea0-47a2-aacf-5de19b427696 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:11.866805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:11.867414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:11.867696 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:11.867965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:11.868607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:46:11.868912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:11.870540 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:11.882718 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1386/2813] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:46:11.887061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08427111-969a-4784-a98c-dcd92ca06f88 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:11.896396 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08427111-969a-4784-a98c-dcd92ca06f88 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:11.901148 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:11.901737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:11.902561 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:11.902881 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:11.903501 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:11.905405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:12.022968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1428/2814] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:46:11 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:46:12.023944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:12.034851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c8db3-b265-41b8-a36a-d90c24939138 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:12.101113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:12.101764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.102015 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.102292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.102940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:12.104853 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:12.253905 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1387/2815] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:46:12 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:46:12.258529 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:12.269820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682fc3-e62e-4105-88cc-677dd227e86f admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:12.274922 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:12.275527 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.275804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.276077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.276723 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:12.278385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:12.288931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1429/2816] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:46:12.293555 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:12.303967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04016e8-273f-4c70-8781-e88ca5ea99cb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:12.309259 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f23d4d-9fc7-4192-af42-ff3125ef0fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:12.313641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23d4d-9fc7-4192-af42-ff3125ef0fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.313641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23d4d-9fc7-4192-af42-ff3125ef0fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.313641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23d4d-9fc7-4192-af42-ff3125ef0fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.313641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f23d4d-9fc7-4192-af42-ff3125ef0fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:12.313641 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f23d4d-9fc7-4192-af42-ff3125ef0fe1 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:12.323503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1388/2817] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:46:12.327976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:12.338015 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7669646-fa6b-4dd2-841e-1f9f9345fb56 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:12.343143 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3a9ef-90cf-40a4-8f2a-ba28587c7261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:12.343808 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3a9ef-90cf-40a4-8f2a-ba28587c7261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.344089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3a9ef-90cf-40a4-8f2a-ba28587c7261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.344361 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3a9ef-90cf-40a4-8f2a-ba28587c7261 admin admin] PATH_INFO: `/v3/projects/3aa2b7cc3a1e427daa750a56d8fde9bd/users/fb1025ebea1d4041a7c2bf176161107a/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.360500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3a9ef-90cf-40a4-8f2a-ba28587c7261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa2b7cc3a1e427daa750a56d8fde9bd, user_id=fb1025ebea1d4041a7c2bf176161107a, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:12.364427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3a9ef-90cf-40a4-8f2a-ba28587c7261 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:12.375935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.376298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.378338 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.408302 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:12.409602 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:12.433795 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1430/2818] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:46:12 2022] PUT /identity/v3/projects/3aa2b7cc3a1e427daa750a56d8fde9bd/users/fb1025ebea1d4041a7c2bf176161107a/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:12.445059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.445357 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.446039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.474215 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1389/2819] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:46:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:46:12.474526 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] MFA Rules not processed for user `fb1025ebea1d4041a7c2bf176161107a`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:12.475748 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:12.544426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1431/2820] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:46:12.555288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:12.556682 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:12.562166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:12.613283 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83863a5e-1364-4a46-bac3-fe85e3c7d344 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:12.660581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f729f-c914-4dd1-8fbb-abc598cf815f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:12.661274 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f729f-c914-4dd1-8fbb-abc598cf815f service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.661568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f729f-c914-4dd1-8fbb-abc598cf815f service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.661843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f729f-c914-4dd1-8fbb-abc598cf815f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.671674 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f729f-c914-4dd1-8fbb-abc598cf815f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:12.673288 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f729f-c914-4dd1-8fbb-abc598cf815f service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:12.678642 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:12.680031 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:12.682951 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1390/2821] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:12.754159 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89698cbf-81da-4785-a173-3924b29ac88b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:12.759468 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:12.769013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:12.769013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:12.769013 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:12.787281 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:12.825914 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:12.827514 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:12.835677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1432/2822] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:46:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 21:46:13.806231 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7955-e94e-4348-8e28-11549faf80d9 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:13.806703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7955-e94e-4348-8e28-11549faf80d9 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:13.806819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7955-e94e-4348-8e28-11549faf80d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:13.826944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-654e7955-e94e-4348-8e28-11549faf80d9 None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:13.828200 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-654e7955-e94e-4348-8e28-11549faf80d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:13.835214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1391/2823] 10.222.0.60 () {58 vars in 967 bytes} [Fri Sep 9 21:46:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:13.848809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:13.860443 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41387f0-ca2a-4709-a6ae-8f07ce08a789 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:13.865784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:13.866421 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:13.866701 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:13.867113 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:13.876968 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:13.878891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:13.893672 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1433/2824] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:46:14.540781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950489-2658-474b-b08f-cbe1082b60af None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:14.541096 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950489-2658-474b-b08f-cbe1082b60af None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:14.541377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950489-2658-474b-b08f-cbe1082b60af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:14.561376 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-92950489-2658-474b-b08f-cbe1082b60af None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:14.562574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-92950489-2658-474b-b08f-cbe1082b60af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:14.569686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1392/2825] 10.222.0.60 () {58 vars in 1009 bytes} [Fri Sep 9 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:14.582337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:14.593498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737a245-e162-4920-b890-a8ea3ffdc7f7 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:14.598756 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:14.599352 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:14.604964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:14.604964 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:14.608870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:14.610522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:14.618405 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1434/2826] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:46:15.378514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:15.378982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:15.379091 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:15.398454 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] MFA Rules not processed for user `ee17ca4bc9cc441b9be64129c7ebb212`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:15.399672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:15.408121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1393/2827] 10.222.0.60 () {58 vars in 967 bytes} [Fri Sep 9 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:15.421546 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:15.432098 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac750bc7-216e-42c6-9db6-6f3ed12b1544 service swift] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:15.437611 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5a2d-078c-4995-a533-38294363d5a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6b146dd405411db127d9668822cbc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:15.438247 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5a2d-078c-4995-a533-38294363d5a0 service swift] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:15.438522 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5a2d-078c-4995-a533-38294363d5a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:15.438790 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5a2d-078c-4995-a533-38294363d5a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:15.446743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a5a2d-078c-4995-a533-38294363d5a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:15.448300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a5a2d-078c-4995-a533-38294363d5a0 service swift] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:15.456695 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1435/2828] 10.222.0.60 () {60 vars in 1384 bytes} [Fri Sep 9 21:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:46:18.268627 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:18.270024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:18.336650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d9c7-4007-4f82-b6eb-a7de06b37dfd None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:18.341203 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:18.342480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:18.342840 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:18.343117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] PATH_INFO: `/v3/users/c25337731ebe43c99d17fa7df671be7e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:18.344244 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25337731ebe43c99d17fa7df671be7e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:18.346199 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:18.599317 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:18.601810 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25337731ebe43c99d17fa7df671be7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:18.602495 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25337731ebe43c99d17fa7df671be7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:18.610245 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25337731ebe43c99d17fa7df671be7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:18.625727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25337731ebe43c99d17fa7df671be7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:18.625727 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25337731ebe43c99d17fa7df671be7e'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:18.725672 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1394/2829] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:46:18 2022] DELETE /identity/v3/users/c25337731ebe43c99d17fa7df671be7e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:18.730246 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:18.730691 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:18.730816 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:18.752248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:18.759395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:18.815599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1436/2830] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:18.825669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:18.828729 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:18.892828 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e90a-1245-4d8a-95ca-6e689d16bb56 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:18.896483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b30028-5366-43d8-a332-505c2d8a2403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:18.897120 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30028-5366-43d8-a332-505c2d8a2403 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:18.897405 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30028-5366-43d8-a332-505c2d8a2403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:18.897679 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30028-5366-43d8-a332-505c2d8a2403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:18.907116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b30028-5366-43d8-a332-505c2d8a2403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:18.908791 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b30028-5366-43d8-a332-505c2d8a2403 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:18.918301 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1395/2831] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:19.216787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:19.217230 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:19.232991 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fedff8-a478-4bc2-94af-bfc36d4c153e None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:19.238767 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:19.241140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:19.241140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:19.241140 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] PATH_INFO: `/v3/projects/1e172de735f946e0a70579256283b7fe` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:19.241562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e172de735f946e0a70579256283b7fe)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:19.243284 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:19.384976 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e172de735f946e0a70579256283b7fe', 'request_id': 'req-170c59ee-9413-4082-aad6-1a77525e7c2e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:19.390724 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e172de735f946e0a70579256283b7fe', 'request_id': 'req-170c59ee-9413-4082-aad6-1a77525e7c2e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:19.401998 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e172de735f946e0a70579256283b7fe', 'request_id': 'req-170c59ee-9413-4082-aad6-1a77525e7c2e'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:19.498655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] The token cache is being invalidate because project 1e172de735f946e0a70579256283b7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:46:19.500801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:19.500801 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-170c59ee-9413-4082-aad6-1a77525e7c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:19.502029 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1437/2832] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:46:19 2022] DELETE /identity/v3/projects/1e172de735f946e0a70579256283b7fe => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:19.507265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad3fd5-30ec-4f1b-a8bd-8cbc462200e4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:19.508156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad3fd5-30ec-4f1b-a8bd-8cbc462200e4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:19.508829 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad3fd5-30ec-4f1b-a8bd-8cbc462200e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:19.532629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-33ad3fd5-30ec-4f1b-a8bd-8cbc462200e4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:19.534028 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-33ad3fd5-30ec-4f1b-a8bd-8cbc462200e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:19.620256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1396/2833] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:19.625894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53bcb-aa2c-4aa5-aaa7-e11d4faa0ee3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:19.626193 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53bcb-aa2c-4aa5-aaa7-e11d4faa0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:19.626465 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b53bcb-aa2c-4aa5-aaa7-e11d4faa0ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:19.635906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:19.648035 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-51b53bcb-aa2c-4aa5-aaa7-e11d4faa0ee3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:19.649273 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-51b53bcb-aa2c-4aa5-aaa7-e11d4faa0ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:19.658070 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1438/2834] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:19.662409 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad3fd5-30ec-4f1b-a8bd-8cbc462200e4 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:19.672466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad3fd5-30ec-4f1b-a8bd-8cbc462200e4 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:19.677119 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:19.677743 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:19.678021 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:19.678322 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:19.678963 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:46:19.679272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:19.680941 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:19.693153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1397/2835] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:46:19.697415 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53bcb-aa2c-4aa5-aaa7-e11d4faa0ee3 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:19.707647 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b53bcb-aa2c-4aa5-aaa7-e11d4faa0ee3 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:19.713182 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:19.713786 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:19.714056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:19.714319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:19.714944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:19.716803 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:19.824170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1439/2836] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:46:19 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:46:19.829782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:19.849425 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d965-b038-43a9-8cbd-e5231c994b7c admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:19.925076 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:19.935498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:19.936251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:19.936573 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:19.936857 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] PATH_INFO: `/v3/users` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:19.937517 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:19.939512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:20.051714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1398/2837] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:46:19 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:46:20.055670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:20.066108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699f427-d1aa-4c5c-ad11-f3da57b1e497 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:20.070464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:20.071054 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:20.071327 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:20.071599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:20.072231 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:20.073906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:20.083799 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1440/2838] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:46:20.087686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:20.098141 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ceb25-5931-47e2-b10b-2bf6fc3e994a admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:20.102708 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd3781-0ce7-4411-baca-3fb1c7a8b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:20.103298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd3781-0ce7-4411-baca-3fb1c7a8b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:20.103581 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd3781-0ce7-4411-baca-3fb1c7a8b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:20.111607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd3781-0ce7-4411-baca-3fb1c7a8b3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:20.111607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd3781-0ce7-4411-baca-3fb1c7a8b3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:20.111607 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd3781-0ce7-4411-baca-3fb1c7a8b3b9 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:20.117285 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1399/2839] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:46:20.121342 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:20.131313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca5e5-830d-4e7a-9fb6-b943b9e8cff8 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:20.136056 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:20.136703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:20.136981 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:20.137344 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] PATH_INFO: `/v3/projects/c8a7061749f14b8185c27e52ce1f6455/users/57286a263cf040ba836816cad460e866/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:20.159577 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a7061749f14b8185c27e52ce1f6455, user_id=57286a263cf040ba836816cad460e866, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:20.163500 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:20.239590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1441/2840] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:46:20 2022] PUT /identity/v3/projects/c8a7061749f14b8185c27e52ce1f6455/users/57286a263cf040ba836816cad460e866/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:20.244635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45f99-a228-4a8f-89c7-2f6bf3dee7d3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:20.244920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45f99-a228-4a8f-89c7-2f6bf3dee7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:20.245221 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45f99-a228-4a8f-89c7-2f6bf3dee7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:20.264846 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-8df45f99-a228-4a8f-89c7-2f6bf3dee7d3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:20.266009 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-8df45f99-a228-4a8f-89c7-2f6bf3dee7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:20.326316 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1400/2841] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:20.337883 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:20.339794 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:20.396916 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46aaf-a0d7-4dc4-a075-ecb2170ae27d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:20.400550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:20.401176 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:20.401452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:20.401721 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:20.410544 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:20.411949 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:20.422144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1442/2842] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:21.720084 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:21.720619 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:21.720733 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:21.750466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] MFA Rules not processed for user `57286a263cf040ba836816cad460e866`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:21.751822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:21.824483 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1401/2843] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:21.836739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:21.838259 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:21.896321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7baa8e-981e-452c-a94e-c7e133f653c4 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:21.899851 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62692e5-a6d1-4a3d-a58e-5e3ddf990b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:21.900457 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62692e5-a6d1-4a3d-a58e-5e3ddf990b39 service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:21.900743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62692e5-a6d1-4a3d-a58e-5e3ddf990b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:21.901093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62692e5-a6d1-4a3d-a58e-5e3ddf990b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:21.910320 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62692e5-a6d1-4a3d-a58e-5e3ddf990b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:21.911741 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62692e5-a6d1-4a3d-a58e-5e3ddf990b39 service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:21.920708 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1443/2844] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:23.370994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:23.372448 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:23.387655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93755de-1383-4552-b3d4-24c23060e87b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:23.392568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:23.393362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:23.393640 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:23.402433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] PATH_INFO: `/v3/users/f7c1893b6cc94e37bb06cde6d22b21a1` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:23.402433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c1893b6cc94e37bb06cde6d22b21a1)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:23.402433 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:23.636536 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c1893b6cc94e37bb06cde6d22b21a1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:23.637209 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c1893b6cc94e37bb06cde6d22b21a1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:23.642568 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:23.644514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c1893b6cc94e37bb06cde6d22b21a1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:23.656993 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c1893b6cc94e37bb06cde6d22b21a1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:23.657769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c1893b6cc94e37bb06cde6d22b21a1'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:23.748475 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1402/2845] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:46:23 2022] DELETE /identity/v3/users/f7c1893b6cc94e37bb06cde6d22b21a1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:23.973444 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8af2-147b-4855-827e-758dc2a4af98 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:23.974302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8af2-147b-4855-827e-758dc2a4af98 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:23.974302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8af2-147b-4855-827e-758dc2a4af98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:23.977955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:23.979769 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:23.996629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-7aaa8af2-147b-4855-827e-758dc2a4af98 None None] MFA Rules not processed for user `57286a263cf040ba836816cad460e866`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:23.998250 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7aaa8af2-147b-4855-827e-758dc2a4af98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:24.043564 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:24.059757 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1444/2846] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:24.060314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf34bc-a2c1-4880-bbf4-1c3046d504e5 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:24.068143 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:24.069499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:24.069704 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:24.069988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] PATH_INFO: `/v3/projects/5b0347d24bc1483494c058ad2c65fae8` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:24.073056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0347d24bc1483494c058ad2c65fae8)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:24.075003 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:24.205990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0347d24bc1483494c058ad2c65fae8', 'request_id': 'req-99c7e050-210e-47c3-b36c-f7cafb998a4b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.307786 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0347d24bc1483494c058ad2c65fae8', 'request_id': 'req-99c7e050-210e-47c3-b36c-f7cafb998a4b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.314890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0347d24bc1483494c058ad2c65fae8', 'request_id': 'req-99c7e050-210e-47c3-b36c-f7cafb998a4b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.326690 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] The token cache is being invalidate because project 5b0347d24bc1483494c058ad2c65fae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:46:24.327183 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.327939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.329514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1403/2847] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:46:23 2022] DELETE /identity/v3/projects/5b0347d24bc1483494c058ad2c65fae8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:24.333488 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8af2-147b-4855-827e-758dc2a4af98 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:24.344764 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8af2-147b-4855-827e-758dc2a4af98 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:24.403959 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:24.404592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:24.404888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:24.405453 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] PATH_INFO: `/v3/users/8474527a04db4cd590c0f2020ae42292` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:24.406839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8474527a04db4cd590c0f2020ae42292)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:24.408864 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:24.606335 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8474527a04db4cd590c0f2020ae42292'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.614368 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8474527a04db4cd590c0f2020ae42292'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.707943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8474527a04db4cd590c0f2020ae42292'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.724329 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8474527a04db4cd590c0f2020ae42292'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.725241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8474527a04db4cd590c0f2020ae42292'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:24.731563 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1445/2848] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:46:24 2022] DELETE /identity/v3/users/8474527a04db4cd590c0f2020ae42292 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:24.808400 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:24.809921 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:24.823172 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7e050-210e-47c3-b36c-f7cafb998a4b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:24.891939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:24.892629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:24.892912 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:24.893220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] PATH_INFO: `/v3/users/fb1025ebea1d4041a7c2bf176161107a` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:24.894343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1025ebea1d4041a7c2bf176161107a)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:24.896339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:24.898842 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:24.984069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:24.985583 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:25.001337 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5541c1f-90ed-48c9-a126-f7454ab6a163 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.006045 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.006702 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.006978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.007310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] PATH_INFO: `/v3/projects/0ea7a45c095a4d0faad53b55138c75ed` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.008404 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea7a45c095a4d0faad53b55138c75ed)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.010265 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.098926 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1025ebea1d4041a7c2bf176161107a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.099601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1025ebea1d4041a7c2bf176161107a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.106684 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1025ebea1d4041a7c2bf176161107a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.119080 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1025ebea1d4041a7c2bf176161107a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.119662 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-c3c82c0f-90f2-4243-ad5e-1469ff1930e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1025ebea1d4041a7c2bf176161107a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.142434 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea7a45c095a4d0faad53b55138c75ed', 'request_id': 'req-a52945ba-9902-4de1-a786-ce5195c76451'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.148244 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea7a45c095a4d0faad53b55138c75ed', 'request_id': 'req-a52945ba-9902-4de1-a786-ce5195c76451'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.154532 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea7a45c095a4d0faad53b55138c75ed', 'request_id': 'req-a52945ba-9902-4de1-a786-ce5195c76451'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.157595 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:25.205328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1404/2849] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:46:24 2022] DELETE /identity/v3/users/fb1025ebea1d4041a7c2bf176161107a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:25.209939 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9566-0add-4220-9e44-619978b059f4 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.210299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9566-0add-4220-9e44-619978b059f4 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.210703 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9566-0add-4220-9e44-619978b059f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.230115 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-210e9566-0add-4220-9e44-619978b059f4 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:25.231414 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-210e9566-0add-4220-9e44-619978b059f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:25.261454 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] The token cache is being invalidate because project 0ea7a45c095a4d0faad53b55138c75ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:46:25.261746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.262496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a52945ba-9902-4de1-a786-ce5195c76451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.264016 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1446/2850] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:46:24 2022] DELETE /identity/v3/projects/0ea7a45c095a4d0faad53b55138c75ed => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:46:25.268818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.269131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.269410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.290241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:25.292432 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:25.299157 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1405/2851] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:46:25.302629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1447/2852] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:46:25.310892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04049065-2dbc-46e2-bdad-049032d87f7b None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.311212 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04049065-2dbc-46e2-bdad-049032d87f7b None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.311532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04049065-2dbc-46e2-bdad-049032d87f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.315155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.316469 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:25.331984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-04049065-2dbc-46e2-bdad-049032d87f7b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:25.333196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-04049065-2dbc-46e2-bdad-049032d87f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:25.341513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1406/2853] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:25.345694 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04049065-2dbc-46e2-bdad-049032d87f7b None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.354633 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04049065-2dbc-46e2-bdad-049032d87f7b None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.360094 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.360686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.360962 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.361265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.361907 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:46:25.362207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.363859 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.375520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1407/2854] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:46:25.378115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a63607-8e43-4258-a941-0d80fda05062 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.379663 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.381901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.382548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.382826 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.383099 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.390045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba1655-0722-4bec-aeb4-1166a1e3a459 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.395808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.396625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.396975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.397144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.397401 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.398107 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.399059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.400391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.411818 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1448/2855] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:46:25.506350 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1408/2856] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:46:25 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:46:25.507472 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.517682 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8bc9e-ac23-43bc-b5bb-926258256a3d service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.573629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.574269 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.574549 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.574829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.575463 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.577870 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.664965 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1449/2857] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:46:25 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:46:25.669492 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.680336 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98248ed-a057-4894-8434-c08616fd7a86 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.685059 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.685913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.686207 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.686486 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.687281 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.690358 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.702697 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1409/2858] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:46:25.707195 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.717592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49310f7-f2aa-4d69-8743-cfc1aea64c5d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.722789 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.723385 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.723664 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.724436 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.724592 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.726186 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.742540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1450/2859] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:46:25.745600 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.756381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3e4e4-639b-458d-991d-54681b578993 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.761201 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c72f1-923d-4d20-8629-88ac5bd6aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.761882 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c72f1-923d-4d20-8629-88ac5bd6aa6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.762161 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c72f1-923d-4d20-8629-88ac5bd6aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.762430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c72f1-923d-4d20-8629-88ac5bd6aa6e admin admin] PATH_INFO: `/v3/projects/81301780f05340fd8d5e6358717ca540/users/8ec72a9b688840dc8242c925f9ae7e4a/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.778575 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c72f1-923d-4d20-8629-88ac5bd6aa6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81301780f05340fd8d5e6358717ca540, user_id=8ec72a9b688840dc8242c925f9ae7e4a, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.781801 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c72f1-923d-4d20-8629-88ac5bd6aa6e admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.837641 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:25.839844 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:25.854191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182a95-52da-43cd-bd5a-523f7ea4fd2d admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:25.859698 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:25.860341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.860620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.860891 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] PATH_INFO: `/v3/projects/3aa2b7cc3a1e427daa750a56d8fde9bd` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.862090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa2b7cc3a1e427daa750a56d8fde9bd)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:25.863999 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:25.875923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1410/2860] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:46:25 2022] PUT /identity/v3/projects/81301780f05340fd8d5e6358717ca540/users/8ec72a9b688840dc8242c925f9ae7e4a/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:25.886524 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:25.886884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:25.887312 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:25.896931 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:25.917480 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] MFA Rules not processed for user `8ec72a9b688840dc8242c925f9ae7e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:25.918686 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:25.986653 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1411/2861] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:46:25.994435 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa2b7cc3a1e427daa750a56d8fde9bd', 'request_id': 'req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:25.998292 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:26.000271 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:26.001090 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa2b7cc3a1e427daa750a56d8fde9bd', 'request_id': 'req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.007849 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa2b7cc3a1e427daa750a56d8fde9bd', 'request_id': 'req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.009589 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:26.056744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1576-4fdb-4c26-9dd3-0cc9a2ab3fea None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:26.084381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] The token cache is being invalidate because project 3aa2b7cc3a1e427daa750a56d8fde9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81611) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:46:26.084673 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.085341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.086995 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1451/2862] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:46:25 2022] DELETE /identity/v3/projects/3aa2b7cc3a1e427daa750a56d8fde9bd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:26.108604 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35c91-ed0c-4346-94c4-39141dba2691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:26.109294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35c91-ed0c-4346-94c4-39141dba2691 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:26.109569 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35c91-ed0c-4346-94c4-39141dba2691 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:26.109843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35c91-ed0c-4346-94c4-39141dba2691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:26.111772 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9be35c91-ed0c-4346-94c4-39141dba2691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:26.183893 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be35c91-ed0c-4346-94c4-39141dba2691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:26.185395 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be35c91-ed0c-4346-94c4-39141dba2691 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:26.197194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1412/2863] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:46:26.220726 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:26.222243 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:26.302580 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de39223-6aaf-4600-a8ea-b223d6ca8bcf admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:26.307663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:26.308412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:26.308590 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:26.308892 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] PATH_INFO: `/v3/users/8ec72a9b688840dc8242c925f9ae7e4a` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:26.310091 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec72a9b688840dc8242c925f9ae7e4a)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:26.312640 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:26.635226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec72a9b688840dc8242c925f9ae7e4a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.642648 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec72a9b688840dc8242c925f9ae7e4a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.706038 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec72a9b688840dc8242c925f9ae7e4a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.718665 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec72a9b688840dc8242c925f9ae7e4a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.719466 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec72a9b688840dc8242c925f9ae7e4a'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:26.725377 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1452/2864] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:46:26 2022] DELETE /identity/v3/users/8ec72a9b688840dc8242c925f9ae7e4a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:26.730045 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:26.730337 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:26.730614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:26.739258 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=100 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:26.751137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:26.752391 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:26.810913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1413/2865] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:26.820989 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:26.822533 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:26.895229 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3e5a-8a20-4434-a956-a99f27b3b6b4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:26.898900 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98ee65-730e-40f9-8d31-67032d34c83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:26.899507 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ee65-730e-40f9-8d31-67032d34c83e service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:26.899787 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ee65-730e-40f9-8d31-67032d34c83e service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:26.900061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ee65-730e-40f9-8d31-67032d34c83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:26.910266 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98ee65-730e-40f9-8d31-67032d34c83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:26.911798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98ee65-730e-40f9-8d31-67032d34c83e service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:26.923211 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1453/2866] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:27.658193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:27.659655 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:27.672755 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522638ac-1ed5-4f2f-b73a-8d8f53cde77f None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:27.678260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:27.678932 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:27.679230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:27.679500 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] PATH_INFO: `/v3/projects/81301780f05340fd8d5e6358717ca540` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:27.680648 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81301780f05340fd8d5e6358717ca540)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:27.682616 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:27.819046 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81301780f05340fd8d5e6358717ca540', 'request_id': 'req-d9554436-c453-40d8-83da-f41400e2a00a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:27.908693 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81301780f05340fd8d5e6358717ca540', 'request_id': 'req-d9554436-c453-40d8-83da-f41400e2a00a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:27.914990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81301780f05340fd8d5e6358717ca540', 'request_id': 'req-d9554436-c453-40d8-83da-f41400e2a00a'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:27.926665 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] The token cache is being invalidate because project 81301780f05340fd8d5e6358717ca540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:46:27.926958 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:27.928012 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-d9554436-c453-40d8-83da-f41400e2a00a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:27.929298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1414/2867] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:46:27 2022] DELETE /identity/v3/projects/81301780f05340fd8d5e6358717ca540 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:46:27.934154 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958668-7516-4c8d-a91c-d0f06245f928 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:27.934663 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958668-7516-4c8d-a91c-d0f06245f928 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:27.934770 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958668-7516-4c8d-a91c-d0f06245f928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:27.955773 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-53958668-7516-4c8d-a91c-d0f06245f928 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:27.957123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-53958668-7516-4c8d-a91c-d0f06245f928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:27.968077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:28.027226 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1454/2868] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:28.036388 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe690d5-a5ac-43dd-9910-788b677543d3 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.036673 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe690d5-a5ac-43dd-9910-788b677543d3 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.037007 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe690d5-a5ac-43dd-9910-788b677543d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.059177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-fbe690d5-a5ac-43dd-9910-788b677543d3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:28.060406 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fbe690d5-a5ac-43dd-9910-788b677543d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:28.069086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1415/2869] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:28.073401 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53958668-7516-4c8d-a91c-d0f06245f928 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.084115 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53958668-7516-4c8d-a91c-d0f06245f928 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.088627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.089282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.089560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.089830 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.090502 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:46:28.090829 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.092400 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:28.104282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1455/2870] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:46:28.108863 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe690d5-a5ac-43dd-9910-788b677543d3 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.118638 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe690d5-a5ac-43dd-9910-788b677543d3 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.123659 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.124272 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.125124 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.125398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.126062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.127970 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:28.253176 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1416/2871] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:46:28 2022] POST /identity/v3/projects => generated 361 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:46:28.257653 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.268089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947dbb7-99ec-451b-bf92-7bc47ab66afb admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.325540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.326356 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.326637 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.326907 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.327540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.330096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:28.405102 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1456/2872] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:46:28 2022] POST /identity/v3/users => generated 281 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:46:28.409328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.419728 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29966ee-ac4f-4392-8a13-b810569e8e8f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.425872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.426487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.426766 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.427067 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.427675 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.429428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:28.441647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1417/2873] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:46:28.445650 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.455880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591ae4a-2e2a-4e6b-af7e-9119a0baa354 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.460520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0f6a-7eb0-408a-89e8-62d0989d1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.461152 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0f6a-7eb0-408a-89e8-62d0989d1c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.461433 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0f6a-7eb0-408a-89e8-62d0989d1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.462815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0f6a-7eb0-408a-89e8-62d0989d1c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.462815 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0f6a-7eb0-408a-89e8-62d0989d1c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.463926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0f6a-7eb0-408a-89e8-62d0989d1c37 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:28.474196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1457/2874] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:46:28.478349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.488775 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977abbd-81e4-4120-9b47-d895aaab6aeb admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.493378 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.494024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.494299 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.494572 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] PATH_INFO: `/v3/projects/04c24dc3d9994f68ac5d535616cbb735/users/1eba40e649a74c71a07a965b64a400fb/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.510275 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c24dc3d9994f68ac5d535616cbb735, user_id=1eba40e649a74c71a07a965b64a400fb, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.512945 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:28.576642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1418/2875] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:46:28 2022] PUT /identity/v3/projects/04c24dc3d9994f68ac5d535616cbb735/users/1eba40e649a74c71a07a965b64a400fb/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:28.592677 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f448f-e0c6-4be8-b63b-6b931c83eabc None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.592962 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f448f-e0c6-4be8-b63b-6b931c83eabc None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.593308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f448f-e0c6-4be8-b63b-6b931c83eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.621393 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1e1f448f-e0c6-4be8-b63b-6b931c83eabc None None] MFA Rules not processed for user `1eba40e649a74c71a07a965b64a400fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:28.622603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1e1f448f-e0c6-4be8-b63b-6b931c83eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:28.690670 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1458/2876] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:28.727868 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.729626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:28.759177 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:28.788709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e669-411b-4fd0-a057-b5f3b00d732f admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.792544 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b08622-7f43-4b4a-84e0-f4b40ccd5d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.793211 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b08622-7f43-4b4a-84e0-f4b40ccd5d27 service cinder] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.793493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b08622-7f43-4b4a-84e0-f4b40ccd5d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.793765 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b08622-7f43-4b4a-84e0-f4b40ccd5d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.803498 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b08622-7f43-4b4a-84e0-f4b40ccd5d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.804936 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b08622-7f43-4b4a-84e0-f4b40ccd5d27 service cinder] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:28.814006 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1419/2877] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:28.830861 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f448f-e0c6-4be8-b63b-6b931c83eabc None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:28.840671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:28.898452 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f448f-e0c6-4be8-b63b-6b931c83eabc None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:28.903147 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:28.903775 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:28.904047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:28.904315 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] PATH_INFO: `/v3/users/1eba40e649a74c71a07a965b64a400fb` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:28.905455 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eba40e649a74c71a07a965b64a400fb)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:28.907908 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:29.110311 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eba40e649a74c71a07a965b64a400fb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:29.117743 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eba40e649a74c71a07a965b64a400fb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:29.198874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eba40e649a74c71a07a965b64a400fb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:29.217131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eba40e649a74c71a07a965b64a400fb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:29.217875 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eba40e649a74c71a07a965b64a400fb'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:29.226037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1459/2878] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:46:28 2022] DELETE /identity/v3/users/1eba40e649a74c71a07a965b64a400fb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:29.230525 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:29.230819 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:29.231113 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:29.251362 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:29.252623 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:29.317512 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1420/2879] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:29.327196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:29.329459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:29.387623 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b2b4-a4e1-479d-9dca-fb44fb3ba159 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:29.391913 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460a357-96a9-4fc6-ab02-b521410260a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:29.392517 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a357-96a9-4fc6-ab02-b521410260a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:29.392792 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a357-96a9-4fc6-ab02-b521410260a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:29.393088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a357-96a9-4fc6-ab02-b521410260a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:29.404901 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460a357-96a9-4fc6-ab02-b521410260a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:29.407520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460a357-96a9-4fc6-ab02-b521410260a6 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:29.417782 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1460/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:46:29.839955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:29.841273 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:29.857499 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e39cf7-a15f-4e50-9d60-6d1aee269606 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:29.872955 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:29.874171 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:29.875081 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:29.875196 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] PATH_INFO: `/v3/projects/04c24dc3d9994f68ac5d535616cbb735` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:29.876698 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c24dc3d9994f68ac5d535616cbb735)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:29.878741 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:29.993463 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c24dc3d9994f68ac5d535616cbb735', 'request_id': 'req-9254d9a1-cb88-4e20-8215-87a0e3e01689'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:30.072343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c24dc3d9994f68ac5d535616cbb735', 'request_id': 'req-9254d9a1-cb88-4e20-8215-87a0e3e01689'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:30.078503 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c24dc3d9994f68ac5d535616cbb735', 'request_id': 'req-9254d9a1-cb88-4e20-8215-87a0e3e01689'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:30.089651 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] The token cache is being invalidate because project 04c24dc3d9994f68ac5d535616cbb735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:46:30.089879 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:30.090513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:46:30.091988 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1421/2881] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:46:29 2022] DELETE /identity/v3/projects/04c24dc3d9994f68ac5d535616cbb735 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:46:39.413024 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:40.086496 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:46:54.939168 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c221-c2dd-4546-ab33-dcdfbc2597f6 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:54.939654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c221-c2dd-4546-ab33-dcdfbc2597f6 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:54.939766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c221-c2dd-4546-ab33-dcdfbc2597f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:54.958745 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1bd8c221-c2dd-4546-ab33-dcdfbc2597f6 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:54.959983 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1bd8c221-c2dd-4546-ab33-dcdfbc2597f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:55.018820 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1461/2882] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:55.037527 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:55.038999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:55.135092 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d9a1-cb88-4e20-8215-87a0e3e01689 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:55.140509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:55.141166 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:55.141447 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:55.141714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:55.149915 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:55.151559 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:55.161773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1422/2883] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:46:59.284719 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae52bcf-c4d4-4cb8-87cc-33b19961a940 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:59.285313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae52bcf-c4d4-4cb8-87cc-33b19961a940 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:59.285313 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae52bcf-c4d4-4cb8-87cc-33b19961a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:59.305280 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-eae52bcf-c4d4-4cb8-87cc-33b19961a940 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:46:59.306464 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-eae52bcf-c4d4-4cb8-87cc-33b19961a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:59.314063 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1462/2884] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:46:59.328278 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:46:59.329683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:46:59.344187 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802f805-c437-4beb-9c13-6fe2f4b8de22 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:46:59.349625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:46:59.350214 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:46:59.350514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:46:59.350768 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:46:59.358821 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:46:59.360394 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:46:59.371151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1423/2885] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:02.921763 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758fdf4-6236-45b8-b81d-e8a4d5ca733c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:02.922364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758fdf4-6236-45b8-b81d-e8a4d5ca733c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:02.922364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758fdf4-6236-45b8-b81d-e8a4d5ca733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:02.942301 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-1758fdf4-6236-45b8-b81d-e8a4d5ca733c None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:02.943498 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1758fdf4-6236-45b8-b81d-e8a4d5ca733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:02.951196 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1463/2886] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:02.974505 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:02.985509 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ecb6b-e5a1-4b60-9368-1b1022dfd182 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:02.990990 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:02.991578 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:02.991851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:02.992121 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:03.000265 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:03.001858 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:03.011348 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1424/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:05.646627 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9991f7-d092-48da-be6a-9d9bcfa1711a None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:05.647112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9991f7-d092-48da-be6a-9d9bcfa1711a None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:05.647223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9991f7-d092-48da-be6a-9d9bcfa1711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:05.666957 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-aa9991f7-d092-48da-be6a-9d9bcfa1711a None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:05.668083 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-aa9991f7-d092-48da-be6a-9d9bcfa1711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:05.676044 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1464/2888] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:05.691253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:05.702539 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a558a-b394-4fd1-b375-24aa7844d862 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:05.708057 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:05.708650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:05.708927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:05.709226 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:05.717151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:05.723018 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:05.728625 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1425/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:08.860241 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f60e1-aeb1-4d8a-a358-d2b594e346e1 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:08.865671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f60e1-aeb1-4d8a-a358-d2b594e346e1 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:08.865671 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f60e1-aeb1-4d8a-a358-d2b594e346e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:08.881170 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-238f60e1-aeb1-4d8a-a358-d2b594e346e1 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:08.882458 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-238f60e1-aeb1-4d8a-a358-d2b594e346e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:08.891309 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1465/2890] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:08.927614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:08.939174 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4f2e-9830-424c-9be6-e5e07a275b4b service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:08.946626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:08.946626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:08.946626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:08.946626 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:08.954359 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:08.955870 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:08.965298 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1426/2891] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:12.094290 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbebb-ab17-427b-b1e7-5d8f8796e499 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:12.096853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbebb-ab17-427b-b1e7-5d8f8796e499 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:12.096853 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cbebb-ab17-427b-b1e7-5d8f8796e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:12.119659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-005cbebb-ab17-427b-b1e7-5d8f8796e499 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:12.121087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-005cbebb-ab17-427b-b1e7-5d8f8796e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:12.129511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1466/2892] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:12.156826 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:12.169700 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebec7b4-52b7-43e9-b225-6849b566d810 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:12.175635 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:12.176230 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:12.176511 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:12.176782 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:12.186510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:12.188086 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:12.199467 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1427/2893] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:22.112354 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=42 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:47:22.194416 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=73 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:47:27.926685 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749698e-74bc-4167-a320-e59fa952779c None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:27.927173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749698e-74bc-4167-a320-e59fa952779c None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:27.927276 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749698e-74bc-4167-a320-e59fa952779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:27.945644 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-a749698e-74bc-4167-a320-e59fa952779c None None] MFA Rules not processed for user `57286a263cf040ba836816cad460e866`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:27.946821 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a749698e-74bc-4167-a320-e59fa952779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:28.000798 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1467/2894] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:28.244038 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:28.245959 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:28.302383 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328df1a5-c7c3-4178-b6b0-5f4d5999d57f service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:28.305999 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:28.306601 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:28.306884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:28.307156 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:28.310035 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:28.319430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:28.320843 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:28.329994 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1428/2895] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:37.994248 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=25 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:47:38.326256 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=26 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:47:45.446446 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c1e6d-96ec-4359-80a7-c2e3bbb9a3e3 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:45.446871 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c1e6d-96ec-4359-80a7-c2e3bbb9a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:45.447000 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c1e6d-96ec-4359-80a7-c2e3bbb9a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:45.468319 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-277c1e6d-96ec-4359-80a7-c2e3bbb9a3e3 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:45.469562 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-277c1e6d-96ec-4359-80a7-c2e3bbb9a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:45.477287 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1468/2896] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:45.513238 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:45.526099 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0dd8c-3c7d-4766-bf05-e30fee1c59a5 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:45.532222 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:45.533193 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:45.539153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:45.539153 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:45.541742 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:45.543309 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:45.553487 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1429/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:49.175089 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e9a4-7255-4ee6-9184-2bb2f13e0438 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:49.175620 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e9a4-7255-4ee6-9184-2bb2f13e0438 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:49.175731 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e9a4-7255-4ee6-9184-2bb2f13e0438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:49.195847 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-88f2e9a4-7255-4ee6-9184-2bb2f13e0438 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:49.197087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-88f2e9a4-7255-4ee6-9184-2bb2f13e0438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:49.205121 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1469/2898] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:49.227837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:49.239738 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd08f5-d04c-420f-b688-6ea9222dee96 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:49.245206 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:49.245773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:49.246049 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:49.246319 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:49.254692 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:49.256184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:49.265526 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1430/2899] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:52.001485 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c6061-c72f-4044-9d9f-a5e6289fb011 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:52.002037 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c6061-c72f-4044-9d9f-a5e6289fb011 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:52.002155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c6061-c72f-4044-9d9f-a5e6289fb011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:52.021931 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-689c6061-c72f-4044-9d9f-a5e6289fb011 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:52.023134 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-689c6061-c72f-4044-9d9f-a5e6289fb011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:52.031738 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1470/2900] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:52.072072 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:52.083985 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774d6c5-6b0c-4f0b-92d3-3e85afdb8af4 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:52.089469 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:52.090060 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:52.090339 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:52.090611 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:52.098788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:52.100428 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:52.110194 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1431/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:55.178894 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4aaf3-3913-4d85-9db1-faee39852909 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:55.179364 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4aaf3-3913-4d85-9db1-faee39852909 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:55.179484 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4aaf3-3913-4d85-9db1-faee39852909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:55.199062 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-edf4aaf3-3913-4d85-9db1-faee39852909 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:55.200251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-edf4aaf3-3913-4d85-9db1-faee39852909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:55.208973 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1471/2902] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:55.225807 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:55.237823 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab99c4-f3aa-430e-9ba7-71dceb271964 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:55.243364 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:55.243960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:55.244241 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:55.244514 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:55.253227 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:55.254872 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:55.264410 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1432/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:47:58.450569 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:58.451079 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:58.451207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:58.471615 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:47:58.472811 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:47:58.480735 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1472/2904] 10.222.0.50 () {58 vars in 1016 bytes} [Fri Sep 9 21:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:47:58.514927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:47:58.526774 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135ec7f-423f-4013-8740-19548b59cc6a service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:47:58.532260 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:47:58.532876 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:47:58.533190 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:47:58.533473 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:47:58.541371 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:47:58.542940 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:47:58.552520 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1433/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:48:01.568980 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:01.570389 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:01.627096 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006843c-f6ab-4123-a943-a483b3fd6db9 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:01.630603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1852c201959444ca8066470206aa6167', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:01.631207 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:01.631481 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:01.631751 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:01.633459 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:01.647174 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:01.648578 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:01.659597 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1473/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:48:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:48:04.606589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:04.616516 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd83cc7-a307-4b2d-bf7f-6cfc01f3d144 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:04.620101 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:04.620688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:04.620967 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:04.621269 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:04.622938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:04.635975 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:04.637430 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:04.648011 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1434/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:48:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:48:11.654427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=41 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:48:14.643253 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=36 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:48:30.756480 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:30.758097 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:30.772317 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9984-bf00-4592-b0c6-f2e9cd09c0dd service cinder] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:30.776926 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:30.777579 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:30.777856 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:30.778128 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] PATH_INFO: `/v3/users/57286a263cf040ba836816cad460e866` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:30.779242 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] RBAC: Authorizing `identity:delete_user(user_id=57286a263cf040ba836816cad460e866)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:30.781172 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:30.909910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57286a263cf040ba836816cad460e866'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:30.916766 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57286a263cf040ba836816cad460e866'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.004201 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57286a263cf040ba836816cad460e866'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.018299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57286a263cf040ba836816cad460e866'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.018971 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-4ba0a728-0c34-4f90-bd26-256b141973da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57286a263cf040ba836816cad460e866'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.025780 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1474/2908] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:48:30 2022] DELETE /identity/v3/users/57286a263cf040ba836816cad460e866 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:48:31.292024 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:31.297713 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a5bb-f1e4-45e4-8792-c49684a6aa2e service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:31.356645 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:31.357306 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:31.357589 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:31.357856 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] PATH_INFO: `/v3/projects/c8a7061749f14b8185c27e52ce1f6455` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:31.358956 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a7061749f14b8185c27e52ce1f6455)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:31.360854 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:31.490909 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a7061749f14b8185c27e52ce1f6455', 'request_id': 'req-a09fd95b-f9fa-4d90-b028-7e419e051997'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.576142 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a7061749f14b8185c27e52ce1f6455', 'request_id': 'req-a09fd95b-f9fa-4d90-b028-7e419e051997'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.582125 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a7061749f14b8185c27e52ce1f6455', 'request_id': 'req-a09fd95b-f9fa-4d90-b028-7e419e051997'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.595323 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] The token cache is being invalidate because project c8a7061749f14b8185c27e52ce1f6455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:48:31.595610 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.596624 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-a09fd95b-f9fa-4d90-b028-7e419e051997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:48:31.598085 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1435/2909] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:48:31 2022] DELETE /identity/v3/projects/c8a7061749f14b8185c27e52ce1f6455 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:48:31.604144 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb936b-068e-4da1-b189-f1c0a8a8c32b None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:31.604634 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb936b-068e-4da1-b189-f1c0a8a8c32b None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:31.604888 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb936b-068e-4da1-b189-f1c0a8a8c32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:31.625678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-94fb936b-068e-4da1-b189-f1c0a8a8c32b None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:48:31.627004 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-94fb936b-068e-4da1-b189-f1c0a8a8c32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:31.686316 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1475/2910] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:48:31.694116 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49acbbf-e8ef-4b60-8d4c-66da85335a23 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:31.694398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49acbbf-e8ef-4b60-8d4c-66da85335a23 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:31.694667 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49acbbf-e8ef-4b60-8d4c-66da85335a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:31.714477 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c49acbbf-e8ef-4b60-8d4c-66da85335a23 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:48:31.715647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c49acbbf-e8ef-4b60-8d4c-66da85335a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:31.724368 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1436/2911] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:48:31.728550 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb936b-068e-4da1-b189-f1c0a8a8c32b None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:31.738179 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb936b-068e-4da1-b189-f1c0a8a8c32b None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:31.743227 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:31.743823 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:31.744101 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:31.744376 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:31.745077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81611) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:48:31.745384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:31.746956 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:31.758678 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1476/2912] 10.222.0.60 () {58 vars in 1153 bytes} [Fri Sep 9 21:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:48:31.762837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49acbbf-e8ef-4b60-8d4c-66da85335a23 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:31.772398 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49acbbf-e8ef-4b60-8d4c-66da85335a23 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:31.776913 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:31.777532 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:31.777808 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:31.778077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:31.778764 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:31.780683 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:31.874779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1437/2913] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:48:31 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:48:31.879039 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:31.889025 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecee39-aa19-4839-adff-a16c6cef8f2a admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:31.946614 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:31.947220 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:31.947496 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:31.947765 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:31.948398 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:31.950314 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:31.958693 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:48:32.027793 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1477/2914] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:48:31 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:48:32.031952 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:32.042745 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4e37-f134-4981-93d2-24353e6ccb0d admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:32.047612 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:32.048205 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:32.048629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:32.048896 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:32.049571 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:32.051151 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:32.061234 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1438/2915] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:48:32.065257 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:32.075629 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c9b67-40d7-4fcf-ac44-3a86ce14f670 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:32.080223 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceeb5c-bd8f-4fea-ad59-652e0103a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:32.080812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceeb5c-bd8f-4fea-ad59-652e0103a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:32.081123 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceeb5c-bd8f-4fea-ad59-652e0103a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:32.081395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceeb5c-bd8f-4fea-ad59-652e0103a3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:32.082030 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceeb5c-bd8f-4fea-ad59-652e0103a3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:32.084299 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceeb5c-bd8f-4fea-ad59-652e0103a3d4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:32.095041 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1478/2916] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:48:32.099138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:32.109117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddbf9-4440-43d9-881c-8bf4fdc579da admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:32.113865 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:32.114502 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:32.114920 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:32.115197 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] PATH_INFO: `/v3/projects/6a250e69428b4072a2ed72df18d35f56/users/c9c4ba7b4afc46d796d31d088f7438ba/roles/964027a7b5cf4ac5b2efd48eaa98c589` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:32.129466 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a250e69428b4072a2ed72df18d35f56, user_id=c9c4ba7b4afc46d796d31d088f7438ba, role_id=964027a7b5cf4ac5b2efd48eaa98c589)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:32.132781 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:32.198669 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1439/2917] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:48:32 2022] PUT /identity/v3/projects/6a250e69428b4072a2ed72df18d35f56/users/c9c4ba7b4afc46d796d31d088f7438ba/roles/964027a7b5cf4ac5b2efd48eaa98c589 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:48:32.203599 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45cb18-876a-42cc-ab92-312eb33b9483 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:32.203915 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45cb18-876a-42cc-ab92-312eb33b9483 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:32.207005 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45cb18-876a-42cc-ab92-312eb33b9483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:32.225188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-da45cb18-876a-42cc-ab92-312eb33b9483 None None] MFA Rules not processed for user `d133fe6374bc4975bb8873cbc865761e`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:48:32.226395 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-da45cb18-876a-42cc-ab92-312eb33b9483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:32.284669 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1479/2918] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:48:32.294296 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:32.296380 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:32.316192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:48:32.353914 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c6b61-7c65-4335-8132-b160898c5f93 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:32.357837 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:32.358437 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:32.358714 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:32.358982 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:32.367983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:32.369419 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:32.378438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1440/2919] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:48:37.572839 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f030-36f0-4cfe-aff5-825d1b0ff6a4 None None] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:37.573426 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f030-36f0-4cfe-aff5-825d1b0ff6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:37.573625 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f030-36f0-4cfe-aff5-825d1b0ff6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:37.608600 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.auth.core [None req-6e96f030-36f0-4cfe-aff5-825d1b0ff6a4 None None] MFA Rules not processed for user `c9c4ba7b4afc46d796d31d088f7438ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81611) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:48:37.610087 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-6e96f030-36f0-4cfe-aff5-825d1b0ff6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:37.692286 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1480/2920] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:48:37.719890 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:37.731129 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e4890-60f8-4f90-96df-7e69f87fc578 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:37.736965 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:37.737756 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:37.738293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:37.738639 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:37.740165 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:37.742251 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:37.861077 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1441/2921] 10.222.0.60 () {60 vars in 1153 bytes} [Fri Sep 9 21:48:37 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:48:37.862655 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96f030-36f0-4cfe-aff5-825d1b0ff6a4 None None] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:37.876917 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96f030-36f0-4cfe-aff5-825d1b0ff6a4 None None] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:37.940332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:37.940950 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:37.941260 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:37.941531 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:37.942739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:37.944659 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:38.022694 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:48:38.029047 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1481/2922] 10.222.0.60 () {60 vars in 1144 bytes} [Fri Sep 9 21:48:37 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:48:38.033294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:38.044308 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413314b2-a495-4fce-a3fe-ba3115021534 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:38.049335 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:38.050071 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:38.055407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:38.055407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:38.055407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:38.055407 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:38.069062 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1442/2923] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:48:38.073341 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:38.083846 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dcc7-fb2a-4c58-bf8e-f5db995c40e6 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:38.088836 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:38.089558 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:38.089838 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:38.090112 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] PATH_INFO: `/v3/projects/cc570700a1cc4b85b1bb8785cee3d26e/users/5041a0ca04e44a3bb11a33bbcd04a02b/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:38.106131 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc570700a1cc4b85b1bb8785cee3d26e, user_id=5041a0ca04e44a3bb11a33bbcd04a02b, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:38.112840 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:38.187716 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1482/2924] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:48:38 2022] PUT /identity/v3/projects/cc570700a1cc4b85b1bb8785cee3d26e/users/5041a0ca04e44a3bb11a33bbcd04a02b/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:48:38.193393 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:38.203510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc149-714f-4d15-b366-caf087bf4c68 admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:38.259615 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c4942-e245-4559-b959-d4a6219619a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:38.260220 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4942-e245-4559-b959-d4a6219619a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:38.260501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4942-e245-4559-b959-d4a6219619a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:38.260773 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4942-e245-4559-b959-d4a6219619a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:38.261439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c4942-e245-4559-b959-d4a6219619a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:38.263064 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c4942-e245-4559-b959-d4a6219619a7 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:38.273484 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1443/2925] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 9 21:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:48:38.277804 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:38.288384 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd018f0-a5be-47fd-981f-7841d89f1e50 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:38.293069 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:38.293746 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:38.294010 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:38.294282 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] PATH_INFO: `/v3/projects/cc570700a1cc4b85b1bb8785cee3d26e/users/5041a0ca04e44a3bb11a33bbcd04a02b/roles/eea82d73b0db450f9f23e5256483a93e` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:38.296512 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc570700a1cc4b85b1bb8785cee3d26e, user_id=5041a0ca04e44a3bb11a33bbcd04a02b, role_id=eea82d73b0db450f9f23e5256483a93e)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:38.299192 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:38.310607 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1483/2926] 10.222.0.60 () {60 vars in 1483 bytes} [Fri Sep 9 21:48:38 2022] PUT /identity/v3/projects/cc570700a1cc4b85b1bb8785cee3d26e/users/5041a0ca04e44a3bb11a33bbcd04a02b/roles/eea82d73b0db450f9f23e5256483a93e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:48:44.151792 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25ada-4607-4d40-a341-e0862f87ee30 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:44.152574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25ada-4607-4d40-a341-e0862f87ee30 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:44.152574 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25ada-4607-4d40-a341-e0862f87ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:44.183493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-c4c25ada-4607-4d40-a341-e0862f87ee30 None None] MFA Rules not processed for user `5041a0ca04e44a3bb11a33bbcd04a02b`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:48:44.184712 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-c4c25ada-4607-4d40-a341-e0862f87ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:44.258328 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1444/2927] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:48:44.274077 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:48:44.275813 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:44.358978 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f254b2-79c0-490e-99d0-ed650926d9b4 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:48:44.365381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:48:44.365809 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:44.366108 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:44.366381 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:44.422155 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:48:44.423739 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:48:44.433482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1484/2928] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:48:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:48:46.922321 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e96fb-d396-4172-8d4e-26c1c009b5f1 None None] REQUEST_METHOD: `POST` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:48:46.922874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e96fb-d396-4172-8d4e-26c1c009b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:48:46.922874 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e96fb-d396-4172-8d4e-26c1c009b5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:48:46.942884 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.auth.core [None req-357e96fb-d396-4172-8d4e-26c1c009b5f1 None None] MFA Rules not processed for user `c9c4ba7b4afc46d796d31d088f7438ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:48:46.943938 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-357e96fb-d396-4172-8d4e-26c1c009b5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:48:46.951210 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1445/2929] 10.222.0.60 () {58 vars in 958 bytes} [Fri Sep 9 21:48:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:48:54.429482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:48:56.937438 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:49:03.558251 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:49:03.559877 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:49:03.635188 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109ad19-a359-4eb2-b47c-5a3fbebfa8ff service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:49:03.640177 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:49:03.640784 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:49:03.641093 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:49:03.641366 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:49:03.643059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:49:03.655011 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:49:03.656568 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:49:03.667505 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1485/2930] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:49:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:49:07.121160 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e96fb-d396-4172-8d4e-26c1c009b5f1 None None] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:49:07.179441 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e96fb-d396-4172-8d4e-26c1c009b5f1 None None] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:49:07.184139 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:49:07.184759 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:49:07.185058 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:49:07.185343 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:49:07.187137 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:49:07.197132 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:49:07.199744 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:49:07.208314 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1446/2931] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:49:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:49:08.093218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:49:08.094910 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:49:08.112676 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e4bd-5bf6-4202-bdad-7969bf32a5fe service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:49:08.118362 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:49:08.119410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:49:08.119410 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:49:08.119699 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:49:08.121487 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:49:08.134596 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:49:08.143173 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:49:08.148120 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1486/2932] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:49:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:49:13.328987 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:49:13.345923 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa757834-c05d-4140-9428-b319bc4fec6a service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:49:13.354983 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97eb6832e7d246d6b6f1813763ac8a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:49:13.355841 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:49:13.356345 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:49:13.356851 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:49:13.358719 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:49:13.377297 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:49:13.378925 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:49:13.390138 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1447/2933] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:49:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:49:16.548727 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:49:16.558059 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bd0b4-356e-4a43-bf15-d7561a832d8f service nova] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:49:16.561654 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:49:16.562238 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:49:16.562511 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:49:16.562777 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:49:16.571332 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:49:16.572725 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:49:16.582657 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1487/2934] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:49:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:49:23.384887 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=32 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:49:26.578371 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=44 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:51:08.518935 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:51:08.530229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76611-7641-4415-8a44-2b3fd49a2191 service nova] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:51:08.535617 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:51:08.536233 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:51:08.536510 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:51:08.536779 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:51:08.538464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:51:08.550453 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:51:08.552005 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:51:08.561614 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1448/2935] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:51:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:51:18.557417 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:51:31.890943 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:51:31.892391 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:51:31.904737 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e511f-3868-4b77-92f5-4bbb58bfbcf0 service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:51:31.909267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:51:31.909267 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:51:31.909603 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:51:31.910412 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:51:31.911621 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:51:31.922374 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:51:31.923476 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:51:31.932587 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1488/2936] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:51:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:51:32.028229 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:51:32.038476 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c2aa-dd68-4e90-8e00-e11348aba3c6 service placement] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:51:32.042294 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf39db40dace49cbba29c0596cbe76bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:51:32.042960 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:51:32.043518 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:51:32.043788 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:51:32.045629 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:51:32.063349 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:51:32.064709 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:51:32.077377 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1449/2937] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:51:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:51:41.928703 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=6 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:51:42.072047 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=6 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:53:05.496812 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:53:05.498560 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:53:05.514548 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0395a30-f1cc-409a-9fa3-e2a171460e4c service neutron] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:53:05.519878 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:53:05.523880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:53:05.523880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:53:05.523880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:53:05.523880 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:53:05.536338 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:53:05.537974 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:53:05.548948 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1489/2938] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:53:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:53:09.053811 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:53:09.065984 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2348e-8c01-484e-93a7-b2c258fbe1e1 service neutron] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:53:09.071642 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:53:09.072365 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] REQUEST_METHOD: `GET` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:53:09.072647 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:53:09.072919 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:53:09.074650 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:53:09.086944 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:53:09.088838 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:53:09.099023 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1450/2939] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:53:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:53:09.188520 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:53:09.255370 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2fdeb-749d-4a30-b8d0-14c1b67e938e service placement] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:53:09.259979 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:53:09.260598 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:53:09.260874 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:53:09.261178 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] PATH_INFO: `/v3/users/c9c4ba7b4afc46d796d31d088f7438ba` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:53:09.262279 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c4ba7b4afc46d796d31d088f7438ba)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:53:09.264258 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:53:09.457308 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c4ba7b4afc46d796d31d088f7438ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:09.464944 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c4ba7b4afc46d796d31d088f7438ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:09.517831 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c4ba7b4afc46d796d31d088f7438ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:09.530557 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c4ba7b4afc46d796d31d088f7438ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:09.531439 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c4ba7b4afc46d796d31d088f7438ba'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:09.537191 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1490/2940] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:53:09 2022] DELETE /identity/v3/users/c9c4ba7b4afc46d796d31d088f7438ba => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:53:09.788513 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:53:09.801439 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3508d-3aa7-4e1e-b039-e85c5e0af0c4 service placement] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:53:09.861184 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:53:09.861822 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:53:09.862599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:53:09.862599 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] PATH_INFO: `/v3/projects/6a250e69428b4072a2ed72df18d35f56` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:53:09.863464 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a250e69428b4072a2ed72df18d35f56)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:53:09.865493 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:53:09.986827 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a250e69428b4072a2ed72df18d35f56', 'request_id': 'req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.054716 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a250e69428b4072a2ed72df18d35f56', 'request_id': 'req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.061324 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a250e69428b4072a2ed72df18d35f56', 'request_id': 'req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.079168 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] The token cache is being invalidate because project 6a250e69428b4072a2ed72df18d35f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:53:10.079457 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.080117 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.084192 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1451/2941] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:53:09 2022] DELETE /identity/v3/projects/6a250e69428b4072a2ed72df18d35f56 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:53:10.089061 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:53:10.090482 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:53:10.103427 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5713-4b0d-4f60-a2c3-439b02fa7482 admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:53:10.161540 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:53:10.162171 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:53:10.162450 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:53:10.162722 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] PATH_INFO: `/v3/users/5041a0ca04e44a3bb11a33bbcd04a02b` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:53:10.163848 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5041a0ca04e44a3bb11a33bbcd04a02b)` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:53:10.165929 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:53:10.171345 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:53:10.396321 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5041a0ca04e44a3bb11a33bbcd04a02b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.404300 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5041a0ca04e44a3bb11a33bbcd04a02b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.478662 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5041a0ca04e44a3bb11a33bbcd04a02b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.491924 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5041a0ca04e44a3bb11a33bbcd04a02b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.492594 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.notifications [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5041a0ca04e44a3bb11a33bbcd04a02b'} {{(pid=81611) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:10.499088 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1491/2942] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 9 21:53:10 2022] DELETE /identity/v3/users/5041a0ca04e44a3bb11a33bbcd04a02b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:53:10.702056 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Authenticating user token {{(pid=81610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:53:10.703501 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.fernet_utils [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:53:10.718266 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b675f-1db8-44b8-868c-1dc97e18bf8b admin admin] Validating token access rules against request {{(pid=81610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:53:10.781636 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd133fe6374bc4975bb8873cbc865761e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490483b5cc64ba0b5021ee96204079c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:53:10.782263 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:53:10.782537 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:53:10.782805 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] PATH_INFO: `/v3/projects/cc570700a1cc4b85b1bb8785cee3d26e` {{(pid=81610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:53:10.783892 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc570700a1cc4b85b1bb8785cee3d26e)` {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:53:10.785927 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] RBAC: Authorization granted {{(pid=81610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:53:10.808560 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:53:10.870355 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc570700a1cc4b85b1bb8785cee3d26e', 'request_id': 'req-4b86180f-215c-4834-a233-2f2d96aa58b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:11.061381 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc570700a1cc4b85b1bb8785cee3d26e', 'request_id': 'req-4b86180f-215c-4834-a233-2f2d96aa58b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:11.067717 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc570700a1cc4b85b1bb8785cee3d26e', 'request_id': 'req-4b86180f-215c-4834-a233-2f2d96aa58b2'} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:11.079748 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] The token cache is being invalidate because project cc570700a1cc4b85b1bb8785cee3d26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:53:11.080039 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:11.080688 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG keystone.notifications [None req-4b86180f-215c-4834-a233-2f2d96aa58b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:53:11.082293 dv-cinder-852210-15-smb devstack@keystone.service[81610]: [pid: 81610|app: 0|req: 1452/2943] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 9 21:53:10 2022] DELETE /identity/v3/projects/cc570700a1cc4b85b1bb8785cee3d26e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:53:20.495539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:53:21.076586 dv-cinder-852210-15-smb devstack@keystone.service[81610]: DEBUG dbcounter [-] [81610] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:56:12.443218 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Authenticating user token {{(pid=81611) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:56:12.444633 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:56:12.583336 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a6065-699a-4d3a-8578-d517eacb825b admin admin] Validating token access rules against request {{(pid=81611) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:56:12.640906 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872c3a7-b128-4e17-9b3b-698c0e2d64f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa725c2a086f4964acefdadb45cc88ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6bad538f2c4a8a937e26b80079a4e5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81611) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:56:12.641539 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c3a7-b128-4e17-9b3b-698c0e2d64f1 service placement] REQUEST_METHOD: `GET` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:56:12.641834 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c3a7-b128-4e17-9b3b-698c0e2d64f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:56:12.642085 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c3a7-b128-4e17-9b3b-698c0e2d64f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81611) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:56:12.643776 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.fernet_utils [None req-c872c3a7-b128-4e17-9b3b-698c0e2d64f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81611) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:56:12.655310 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872c3a7-b128-4e17-9b3b-698c0e2d64f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:56:12.656865 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872c3a7-b128-4e17-9b3b-698c0e2d64f1 service placement] RBAC: Authorization granted {{(pid=81611) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:56:12.666760 dv-cinder-852210-15-smb devstack@keystone.service[81611]: [pid: 81611|app: 0|req: 1492/2944] 10.222.0.60 () {60 vars in 1365 bytes} [Fri Sep 9 21:56:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:56:22.662302 dv-cinder-852210-15-smb devstack@keystone.service[81611]: DEBUG dbcounter [-] [81611] Writing DB stats keystone:SELECT=89 {{(pid=81611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}